00000001:02000400:2.0F:1784756148.103944:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1784756169.244015:0:3181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1784756171.828722:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 509 MB/s 00000001:01000000:2.0:1784756172.079032:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 855 MB/s 00000001:01000000:0.0F:1784756172.328739:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6123 MB/s 00000020:02000000:1.0:1784756173.167876:0:3287:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_g9c9e10a 00000400:02000000:0.0:1784756174.223011:0:3302:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.202.104@tcp [8/256/0/180] 00008000:02000000:2.0:1784756177.541638:0:3452:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1784756221.061774:0:5253:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1784756229.850599:0:5775:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784756229.850610:0:5775:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784756229.850742:0:5775:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000be1dc9d9 00000080:02000400:3.0:1784756229.850755:0:5775:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784756229.867322:0:5775:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784756229.867337:0:5775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784756229.867373:0:5775:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000eb55beef) 00000020:00000080:3.0:1784756229.867391:0:5775:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784756229.939688:0:5775:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784756229.940412:0:5775:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784756230.004438:0:5775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1784756230.004504:0:5775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1784756230.004528:0:5775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1784756230.004591:0:5775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1784756230.004616:0:5775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1784756230.005087:0:5775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784756230.005231:0:5775:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784756230.005243:0:5775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f0204f 00000020:01000004:0.0:1784756230.005251:0:5775:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1784756230.005255:0:5775:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784756230.005260:0:5775:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000be1dc9d9 from MGS 00000020:01000004:0.0:1784756230.005264:0:5775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784756230.005282:0:5775:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bcf9904e) 00000020:00000080:0.0:1784756230.005293:0:5775:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784756230.005399:0:5775:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be1dc9d9 from MGS, refs=2 00080000:01000000:0.0:1784756230.005404:0:5775:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784756230.005410:0:5775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f0205d 00000100:00100000:0.0:1784756230.005529:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784756230.005817:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784756230.005824:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784756230.006415:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784756230.006423:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784756230.007957:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756230.008228:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784756230.008234:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784756230.025540:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784756230.025556:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784756230.026994:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784756230.027003:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1784756230.027873:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756230.027877:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756230.027878:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756230.028676:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756230.028679:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756230.028681:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756230.029364:0:5775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784756230.034403:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784756230.281498:0:5775:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1193 MB/s 00000001:01000000:2.0:1784756230.531958:0:5775:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1071 MB/s 00000001:01000000:0.0:1784756230.783063:0:5775:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 262 MB/s 00000001:01000000:0.0:1784756231.033630:0:5775:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 856 MB/s 00080000:10000000:0.0:1784756231.047793:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1784756231.062163:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784756231.070447:0:5775:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784756231.070463:0:5775:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784756231.071947:0:5775:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1784756231.077053:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784756231.077098:0:5775:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784756231.077824:0:5775:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1784756231.079135:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784756231.079169:0:5775:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784756231.079719:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784756231.081005:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784756231.081013:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784756231.081745:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784756231.081753:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784756231.083199:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784756231.083209:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784756231.084549:0:5775:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784756231.084571:0:5775:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.104@tcp' 00000020:01000004:2.0:1784756231.084573:0:5775:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784756231.084614:0:5775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.104@tcp (typ=mgc) 00000020:00000080:2.0:1784756231.084632:0:5775:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.104@tcp (000000001c447456) 00000020:00000080:2.0:1784756231.084650:0:5775:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784756231.084786:0:5775:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000046f3051c@MGC192.168.202.104@tcp: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1784756231.084951:0:5775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.104@tcp-0 is initialized 00000100:00080000:1.0:1784756231.085162:0:5791:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:2.0:1784756231.085193:0:5775:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784756231.085581:0:5792:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784756231.085608:0:5775:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.104@tcp (uuid f5c73f41-e9a1-4359-8051-7c5e1edb844a) 00000020:00000080:2.0:1784756231.085621:0:5775:0:(genops.c:1406:class_connect()) connect: client f5c73f41-e9a1-4359-8051-7c5e1edb844a, cookie 0x1782e2377f0206b 00000100:00080000:2.0:1784756231.085630:0:5775:0:(import.c:510:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784756231.085634:0:5775:0:(import.c:624:import_select_connection()) MGC192.168.202.104@tcp: import 0000000046f3051c using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1784756231.085671:0:5775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bffc5b23 x1871452489908352/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784756231.085692:0:5775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5c73f41-e9a1-4359-8051-7c5e1edb844a->MGS 00000020:01000004:2.0:1784756231.085705:0:5775:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784756231.085709:0:5775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784756231.085718:0:5775:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e42e690b) 00000020:00000080:2.0:1784756231.085726:0:5775:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784756231.086194:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bffc5b23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3318:1871452489908352:0@lo:250: 00000100:00100000:1.0:1784756231.087005:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756231.087086:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908352 00000100:00100000:1.0:1784756231.087093:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908352 00000100:00100000:1.0:1784756231.094081:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756231.094093:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003a111f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3318:x1871452489908352:12345-0@lo:250: 00010000:00080000:1.0:1784756231.094131:0:5787:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f5c73f41-e9a1-4359-8051-7c5e1edb844a@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:1.0:1784756231.094172:0:5787:0:(genops.c:1406:class_connect()) connect: client f5c73f41-e9a1-4359-8051-7c5e1edb844a, cookie 0x1782e2377f02079 00000100:00080000:1.0:1784756231.094625:0:5787:0:(import.c:65:import_set_state_nolock()) 00000000af5c7a08 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784756231.094706:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003a111f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:3318:x1871452489908352:12345-0@lo:250: Request processed in 612us (7701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756231.094714:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756231.108880:0:3318:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784756231.108898:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1784756231.108906:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784756231.108912:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784756231.108915:0:3318:0:(import.c:65:import_set_state_nolock()) 0000000046f3051c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784756231.108920:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784756231.108936:0:3318:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784756231.108943:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bffc5b23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3318:1871452489908352:0@lo:250: 00000100:00100000:2.0:1784756231.117446:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756231.119160:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784756231.119168:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784756231.121550:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784756231.121562:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784756231.125135:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784756231.125148:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784756231.126382:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756231.126572:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784756231.126577:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784756231.130689:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784756231.130708:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1784756231.208204:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784756231.208708:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1784756231.208715:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784756231.210660:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784756231.210721:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784756231.212168:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784756231.212576:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784756231.212587:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784756231.213445:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784756231.213453:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784756231.214606:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756231.214842:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784756231.214848:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784756231.216230:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784756231.216239:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784756231.219037:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756231.219224:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784756231.219231:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784756231.228448:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784756231.228462:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784756231.263140:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784756231.263593:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784756231.263599:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784756231.265190:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784756231.265200:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784756231.268141:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784756231.268154:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784756231.270108:0:5775:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784756231.270141:0:5775:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784756231.270149:0:5775:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784756231.270561:0:5775:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784756231.270593:0:5775:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784756231.270597:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784756231.270599:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784756231.270600:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756231.270601:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756231.270603:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756231.270604:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756231.270605:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784756231.270606:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784756231.270608:0:5775:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756231.270609:0:5775:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756231.270610:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756231.270611:0:5775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784756231.270614:0:5775:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784756231.270616:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784756231.270617:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784756231.270618:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756231.270619:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756231.270620:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756231.270621:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756231.270622:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784756231.270622:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784756231.270623:0:5775:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756231.270630:0:5775:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756231.270630:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756231.270631:0:5775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784756231.270669:0:5775:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784756231.270685:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eed6efe1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908480:0@lo:253: 00000100:00100000:3.0:1784756231.270891:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756231.270934:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000322d4543 going to sleep for 11 seconds 00000100:00100000:2.0:1784756231.271106:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908480 00000100:00100000:2.0:1784756231.271114:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908480 00000100:00100000:2.0:1784756231.271162:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784756231.271177:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f25ab7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:5775:x1871452489908480:12345-0@lo:253: 20000000:01000000:2.0:1784756231.271220:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784756231.271223:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784756231.272035:0:5790:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784756231.272379:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756231.273601:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1784756231.273688:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784756231.273691:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1784756231.273696:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1784756231.273699:0:5790:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1784756231.273714:0:5790:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1784756231.273849:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756231.274083:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1784756231.274096:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784756231.274162:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1784756231.274212:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1784756231.274519:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1784756231.274608:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1784756231.274616:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1784756231.274658:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1784756231.274665:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1784756231.274694:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1784756231.274701:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1784756231.274728:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1784756231.274770:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1784756231.274797:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784756231.274801:0:5790:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1784756231.274813:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756231.275549:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1784756231.275561:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784756231.275610:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1784756231.275646:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1784756231.275695:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1784756231.275718:0:5790:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1784756231.275806:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1784756231.275815:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784756231.275858:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1784756231.276150:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1784756231.276185:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1784756231.276195:0:5790:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1784756231.276491:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1784756231.276501:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1784756231.276533:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1784756231.276567:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1784756231.276716:0:5790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1784756231.277105:0:5790:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784756231.277113:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 10000000:01000000:2.0:1784756231.277683:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000040:00080000:1.0:1784756231.278552:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784756231.279010:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784756231.279033:0:5790:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.104@tcp for mdt 20000000:01000000:2.0:1784756231.279035:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:2.0:1784756231.279071:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784756231.279078:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784756231.279106:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784756231.279112:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:2.0:1784756231.279170:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784756231.279182:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784756231.279212:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784756231.279443:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784756231.279678:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784756231.279681:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784756231.279685:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784756231.279695:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784756231.279698:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784756231.279723:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784756231.279726:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784756231.280550:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1784756231.280790:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784756231.280831:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1784756231.280909:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1784756231.280923:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784756231.280925:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784756231.281704:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784756231.282141:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784756231.282185:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784756231.282219:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1784756231.282233:0:5790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756231.282236:0:5790:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1784756231.282440:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784756231.282443:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784756231.282447:0:5790:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784756231.282453:0:5790:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784756231.283629:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1784756231.284039:0:5790:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784756231.295983:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1784756231.296030:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1784756231.296097:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1784756231.296117:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784756231.296147:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296164:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296173:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296179:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296185:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296191:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296197:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005816e69 already unused, calling callback (000000006e1afd58) 00010000:00010000:1.0:1784756231.296200:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296207:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296219:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296237:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.296446:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005816e69/0x1782e2377f02080 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784756231.296463:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784756231.627034:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f25ab7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:5775:x1871452489908480:12345-0@lo:253: Request processed in 355852us (356138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756231.627054:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756231.627198:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eed6efe1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908480:0@lo:253: 10000000:01000000:0.0:1784756231.627214:0:5775:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784756231.627217:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784756231.627219:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784756231.627220:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756231.627221:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784756231.627223:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756231.627224:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756231.627225:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784756231.627227:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784756231.627228:0:5775:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784756231.627230:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756231.627231:0:5775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784756231.627308:0:5775:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000be1dc9d9 from lustre-MDT0000 10000000:01000000:0.0:1784756231.627352:0:5775:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784756231.627358:0:5775:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784756231.627362:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b76104c8000 10000000:01000000:0.0:1784756231.627366:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756231.627373:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b76104c8000 from 1 10000000:01000000:0.0:1784756231.627376:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784756231.627417:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.627427:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.627437:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756231.627453:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908608:0@lo:101: 00000100:00100000:0.0:1784756231.627521:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.627561:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:3.0:1784756231.627641:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908608 00000100:00100000:3.0:1784756231.627647:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908608 00000100:00100000:3.0:1784756231.627688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756231.627695:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d5376a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:5775:x1871452489908608:12345-0@lo:101: 00010000:00010000:3.0:1784756231.627706:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756231.627717:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006832e1ec/0x1782e2377f0208e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02087 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756231.627737:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006832e1ec/0x1782e2377f0208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02087 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756231.627846:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006832e1ec/0x1782e2377f0208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02087 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756231.627855:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006832e1ec, rc 0) 00000100:00100000:3.0:1784756231.627981:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d5376a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5775:x1871452489908608:12345-0@lo:101: Request processed in 286us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756231.627987:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756231.628464:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908608:0@lo:101: 00010000:00010000:0.0:1784756231.628535:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.628543:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756231.628587:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908736:0@lo:501: 00000100:00100000:0.0:1784756231.628613:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.628674:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.628710:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908736 00000100:00100000:1.0:1784756231.628714:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908736 00000100:00100000:1.0:1784756231.628838:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784756231.628845:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a74ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5775:x1871452489908736:12345-0@lo:501: 00000100:00100000:1.0:1784756231.629068:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a74ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5775:x1871452489908736:12345-0@lo:501: Request processed in 217us (447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784756231.629513:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908736:0@lo:501: 10000000:01000000:0.0:1784756231.629537:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784756231.629552:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.629560:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 0000000034f3248c/0x1782e2377f02087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756231.629568:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b761808f800 10000000:01000000:0.0:1784756231.629572:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784756231.629576:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b761808f800 10000000:01000000:0.0:1784756231.629578:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784756231.629581:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8b761808f800 from 1 10000000:01000000:0.0:1784756231.629584:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784756231.629601:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.629607:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.629613:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756231.629623:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908864:0@lo:101: 00000100:00100000:0.0:1784756231.629650:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756231.629702:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784756231.634486:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.637506:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908864 00000100:00100000:1.0:1784756231.637518:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908864 00000100:00100000:1.0:1784756231.637555:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784756231.637562:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c1ef69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5775:x1871452489908864:12345-0@lo:101: 00010000:00010000:1.0:1784756231.637577:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756231.637597:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005816e69/0x1782e2377f0209c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02095 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.637620:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005816e69/0x1782e2377f0209c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02095 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.637630:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005816e69/0x1782e2377f0209c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02095 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.637657:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005816e69, rc 0) 00000100:00100000:1.0:1784756231.637716:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c1ef69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:5775:x1871452489908864:12345-0@lo:101: Request processed in 155us (8066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756231.637723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784756231.638575:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908864:0@lo:101: 00010000:00010000:0.0:1784756231.638592:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0209c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.638600:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0209c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756231.638629:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784756231.638640:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0209c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.638646:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000280d7fb8/0x1782e2377f02095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0209c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756231.638653:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784756231.638658:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756231.638663:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b761808f800 10000000:01000000:0.0:1784756231.638665:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784756231.638668:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784756231.638671:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784756231.638692:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.638699:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.638707:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756231.638724:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908992:0@lo:101: 00000100:00100000:0.0:1784756231.638767:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.638797:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.640530:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489908992 00000100:00100000:1.0:1784756231.640541:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489908992 00000100:00100000:1.0:1784756231.640578:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784756231.640585:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab445b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:5775:x1871452489908992:12345-0@lo:101: 00010000:00010000:1.0:1784756231.640598:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756231.640612:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000467156c9/0x1782e2377f020aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f020a3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.640632:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000467156c9/0x1782e2377f020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f020a3 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.640641:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000467156c9/0x1782e2377f020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f020a3 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756231.640649:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000467156c9, rc 0) 00000100:00100000:1.0:1784756231.640694:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab445b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+8:5775:x1871452489908992:12345-0@lo:101: Request processed in 109us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756231.640700:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756231.640897:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489908992:0@lo:101: 00010000:00010000:0.0:1784756231.640911:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756231.640936:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756231.640998:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909120:0@lo:501: 00000100:00100000:0.0:1784756231.641027:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.641070:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.641181:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909120 00000100:00100000:1.0:1784756231.641185:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909120 00000100:00100000:1.0:1784756231.641201:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756231.641206:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d81972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+8:5775:x1871452489909120:12345-0@lo:501: 00000100:00100000:1.0:1784756231.641507:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d81972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5775:x1871452489909120:12345-0@lo:501: Request processed in 301us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756231.641519:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784756231.642406:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909120:0@lo:501: 00000100:00100000:0.0:1784756231.642441:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909248:0@lo:503: 00000100:00100000:0.0:1784756231.642504:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.642525:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000008d88e263 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.642583:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909248 00000100:00100000:1.0:1784756231.642588:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909248 00000100:00100000:1.0:1784756231.642619:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756231.642625:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbefdc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5775:x1871452489909248:12345-0@lo:503: 00000100:00100000:1.0:1784756231.642784:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbefdc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5775:x1871452489909248:12345-0@lo:503: Request processed in 159us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756231.642791:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784756231.643002:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909248:0@lo:503: 00000100:00100000:1.0:1784756231.644160:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5817:1871452489909376:0@lo:502: 00000100:00100000:1.0:1784756231.644204:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756231.644333:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909376 00000100:00100000:0.0:1784756231.644338:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909376 00000100:00100000:0.0:1784756231.644372:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784756231.644378:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000242d06b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5817:x1871452489909376:12345-0@lo:502: 00000100:00100000:0.0:1784756231.644558:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000242d06b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5817:x1871452489909376:12345-0@lo:502: Request processed in 180us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756231.644565:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756231.644686:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000adb85c25 going to sleep for 11 seconds 00000100:00100000:1.0:1784756231.644702:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5817:1871452489909376:0@lo:502: 00000020:01000000:1.0:1784756231.644725:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756231.644736:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756231.644738:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784756231.644892:0:5817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784756231.644897:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784756231.644915:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e1997e3) 00000020:00000080:1.0:1784756231.644930:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784756231.644936:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784756231.644996:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784756231.645002:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f020b8 00000020:00000080:1.0:1784756231.645217:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784756231.645221:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756231.645225:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756231.645226:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784756231.645229:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756231.645232:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756231.645903:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784756231.645909:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784756231.645916:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ed35a7ba) 00000020:00000080:1.0:1784756231.645928:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784756231.645932:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784756231.645933:0:5817:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784756231.645936:0:5817:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784756231.645942:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784756231.645995:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be1dc9d9 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784756231.646005:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000649cea7f) 00000020:00000080:1.0:1784756231.646013:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784756231.646066:0:5817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784756231.646071:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1782e2377f020cd 00000020:00000080:1.0:1784756231.646174:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784756231.646180:0:5817:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784756231.646184:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1782e2377f020d4 00080000:01000000:1.0:1784756231.646189:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784756231.646192:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f020db 00080000:10000000:1.0:1784756231.647646:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1784756231.647957:0:5817:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1784756231.662767:0:5817:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1784756231.838573:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1784756231.840282:0:5817:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1784756231.846454:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784756231.846758:0:5817:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784756231.870848:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ea1128a7) 00000020:00000080:1.0:1784756231.870876:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784756231.870948:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784756231.870955:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f020e9 00000020:00000080:0.0:1784756231.871504:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784756231.872984:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756231.933625:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756232.025135:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784756232.072696:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:2.0:1784756232.078725:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784756232.151545:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756232.235980:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1784756232.355650:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1782e2377f020f0 00000020:00000080:0.0:1784756232.360117:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784756232.360161:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756232.360167:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756232.360170:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784756232.360175:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756232.360179:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756232.360180:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784756232.360182:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784756232.360184:0:5817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784756232.360187:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756232.360189:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756232.360190:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784756232.360192:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756232.360196:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756232.360197:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784756232.360201:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784756232.360247:0:5817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1784756232.360300:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5817:1871452489909504:0@lo:502: 00000100:00100000:0.0:1784756232.360376:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.360843:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909504 00000100:00100000:1.0:1784756232.360850:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909504 00000100:00100000:1.0:1784756232.360895:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756232.360909:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001df51792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5817:x1871452489909504:12345-0@lo:502: 00000100:00100000:0.0:1784756232.361541:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000080217892 going to sleep for 11 seconds 00000100:00100000:1.0:1784756232.362203:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001df51792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5817:x1871452489909504:12345-0@lo:502: Request processed in 1294us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756232.362212:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784756232.362415:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5817:1871452489909504:0@lo:502: 00000020:01000000:0.0:1784756232.362527:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756232.362533:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756232.362535:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1784756232.362540:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1784756232.363416:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1784756232.363446:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784756232.363490:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.363501:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 0000000036973f6a/0x1782e2377f020a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756232.363509:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b761808f800 from 1 10000000:01000000:3.0:1784756232.363511:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784756232.363557:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.363565:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.363574:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756232.363591:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000204dcc15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909632:0@lo:101: 00000100:00100000:3.0:1784756232.363628:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756232.363659:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000daae752d going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.365040:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909632 00000100:00100000:0.0:1784756232.365049:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909632 00000100:00100000:0.0:1784756232.365089:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784756232.365097:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bb201e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:5775:x1871452489909632:12345-0@lo:101: 00010000:00010000:0.0:1784756232.365119:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756232.365135:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f020f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.365173:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f020f7 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.365183:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f020f7 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.365196:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036f0061c, rc 0) 00000100:00100000:0.0:1784756232.365249:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bb201e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:5775:x1871452489909632:12345-0@lo:101: Request processed in 153us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756232.365256:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784756232.365424:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000204dcc15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909632:0@lo:101: 00010000:00010000:1.0:1784756232.365449:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.365458:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756232.366010:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909760:0@lo:256: 00000100:00100000:1.0:1784756232.366046:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.366074:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e32ada3 going to sleep for 11 seconds 00000100:00100000:2.0:1784756232.366411:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909760 00000100:00100000:2.0:1784756232.366416:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909760 00000100:00100000:2.0:1784756232.366456:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756232.366463:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000074c4be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:5775:x1871452489909760:12345-0@lo:256: 20000000:01000000:2.0:1784756232.366513:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784756232.366518:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784756232.366588:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000074c4be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:5775:x1871452489909760:12345-0@lo:256: Request processed in 126us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756232.366595:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756232.367134:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909760:0@lo:256: 10000000:01000000:1.0:1784756232.368189:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784756232.368209:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.368219:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756232.368226:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b761808f800 from 1 10000000:01000000:1.0:1784756232.368228:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756232.368255:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.368261:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.368275:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756232.368289:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909888:0@lo:101: 00000100:00100000:1.0:1784756232.368324:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.368413:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e32ada3 going to sleep for 11 seconds 00000100:00100000:3.0:1784756232.369821:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489909888 00000100:00100000:3.0:1784756232.369836:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489909888 00000100:00100000:3.0:1784756232.369878:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784756232.369886:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d41216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:5775:x1871452489909888:12345-0@lo:101: 00010000:00010000:3.0:1784756232.369899:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756232.369911:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02105 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.369944:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.369953:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.369961:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046da69a6, rc 0) 00000100:00100000:3.0:1784756232.370018:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d41216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489909888:12345-0@lo:101: Request processed in 133us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756232.370024:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756232.370199:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489909888:0@lo:101: 00010000:00010000:1.0:1784756232.370213:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.370221:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756232.370274:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910016:0@lo:501: 00000100:00100000:1.0:1784756232.370300:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.370328:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e32ada3 going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.370374:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910016 00000100:00100000:0.0:1784756232.370378:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910016 00000100:00100000:0.0:1784756232.370406:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784756232.370412:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042861bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489910016:12345-0@lo:501: 00000100:00100000:0.0:1784756232.370946:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042861bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489910016:12345-0@lo:501: Request processed in 533us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756232.370953:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784756232.371675:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910016:0@lo:501: 00000100:00100000:1.0:1784756232.371707:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910144:0@lo:503: 00000100:00100000:1.0:1784756232.371757:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.371781:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e32ada3 going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.372009:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910144 00000100:00100000:0.0:1784756232.372014:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910144 00000100:00100000:0.0:1784756232.372039:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784756232.372045:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5221bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489910144:12345-0@lo:503: 00000040:00080000:0.0:1784756232.372078:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756232.372130:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5221bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489910144:12345-0@lo:503: Request processed in 85us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756232.372137:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756232.372251:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064d4ccab pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910144:0@lo:503: 00000040:00080000:1.0:1784756232.373651:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784756232.374068:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784756232.374086:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756232.374105:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756232.374123:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756232.374160:0:5775:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784756232.374163:0:5775:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b761808f800 10000000:01000000:2.0:1784756232.374166:0:5775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b761808f800 10000000:01000000:2.0:1784756232.374170:0:5775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784756232.374176:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b761808f800 from 1 10000000:01000000:2.0:1784756232.374178:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756232.374205:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756232.374212:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756232.374221:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756232.374237:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e9bec5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910272:0@lo:101: 00000100:00100000:2.0:1784756232.374284:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756232.374312:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000007a9fc2e2 going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.374391:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910272 00000100:00100000:0.0:1784756232.374398:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910272 00000100:00100000:0.0:1784756232.374443:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784756232.374450:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbcae333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489910272:12345-0@lo:101: 00010000:00010000:0.0:1784756232.374461:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756232.374489:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b36cb5e8/0x1782e2377f0211a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02113 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.374510:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b36cb5e8/0x1782e2377f0211a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02113 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.374520:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b36cb5e8/0x1782e2377f0211a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02113 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756232.374527:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b36cb5e8, rc 0) 00000100:00100000:0.0:1784756232.374575:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbcae333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489910272:12345-0@lo:101: Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756232.374581:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756232.375155:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e9bec5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910272:0@lo:101: 00010000:00010000:2.0:1784756232.375168:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756232.375176:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756232.375221:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e9bec5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910400:0@lo:501: 00000100:00100000:2.0:1784756232.375246:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756232.375261:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 000000007a9fc2e2 going to sleep for 11 seconds 00000100:00100000:3.0:1784756232.375337:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910400 00000100:00100000:3.0:1784756232.375342:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910400 00000100:00100000:3.0:1784756232.375373:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784756232.375378:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016f816ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489910400:12345-0@lo:501: 00000100:00100000:3.0:1784756232.375632:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016f816ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489910400:12345-0@lo:501: Request processed in 253us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756232.375639:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784756232.375669:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e9bec5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910400:0@lo:501: 00000100:00100000:3.0:1784756232.375693:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009dffa909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910528:0@lo:503: 00000100:00100000:3.0:1784756232.375726:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756232.375927:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000979e706d going to sleep for 11 seconds 00000100:00100000:3.0:1784756232.375941:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910528 00000100:00100000:3.0:1784756232.375945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910528 00000100:00100000:3.0:1784756232.375960:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784756232.375965:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d8659f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489910528:12345-0@lo:503: 00000100:00100000:3.0:1784756232.376343:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d8659f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489910528:12345-0@lo:503: Request processed in 377us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756232.376355:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784756232.376390:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009dffa909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489910528:0@lo:503: 00000100:00100000:2.0:1784756232.381283:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b982494c pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5822:1871452489910656:0@lo:502: 00000100:00100000:2.0:1784756232.381358:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756232.381403:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df78a524 going to sleep for 11 seconds 00000100:00100000:3.0:1784756232.381672:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910656 00000100:00100000:3.0:1784756232.381679:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910656 00000100:00100000:3.0:1784756232.381718:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756232.381726:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088e2964b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5822:x1871452489910656:12345-0@lo:502: 00000100:00100000:3.0:1784756232.382300:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088e2964b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5822:x1871452489910656:12345-0@lo:502: Request processed in 574us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756232.382307:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784756232.382395:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b982494c pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5822:1871452489910656:0@lo:502: 00000020:01000004:0.0:1784756232.382462:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784756232.382507:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d08859c2) 00000020:00000080:0.0:1784756232.382527:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784756232.382673:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be1dc9d9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784756232.382678:0:5822:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000be1dc9d9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784756232.382680:0:5822:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000be1dc9d9 4 00010000:00080000:0.0:1784756232.382704:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ef1db580@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784756232.395617:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784756232.395729:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784756232.395916:0:5822:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784756232.395929:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1782e2377f02128 00000100:00080000:1.0:1784756232.395939:0:5822:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784756232.395952:0:5822:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ef1db580 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1784756232.396092:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001a9f5e24 x1871452489910784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784756232.396219:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a9f5e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1871452489910784:0@lo:38: 00000100:00100000:2.0:1784756232.396300:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756232.396395:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910784 00000100:00100000:3.0:1784756232.396403:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910784 00000100:00100000:3.0:1784756232.396443:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756232.396449:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac326661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1871452489910784:12345-0@lo:38: 00000100:00080000:1.0:1784756232.396531:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784756232.398380:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac326661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1871452489910784:12345-0@lo:38: Request processed in 1927us (2076us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784756232.398391:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756232.398814:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5822:1871452489910912:0@lo:502: 00000100:00100000:0.0:1784756232.398866:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756232.398892:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489910912 00000100:00100000:0.0:1784756232.398897:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489910912 00000100:00100000:0.0:1784756232.398927:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756232.398940:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bc737f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5822:x1871452489910912:12345-0@lo:502: 00000100:00100000:0.0:1784756232.399162:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bc737f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5822:x1871452489910912:12345-0@lo:502: Request processed in 222us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756232.399169:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756232.399210:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000013869fa1 going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.399229:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5822:1871452489910912:0@lo:502: 00000040:00080000:0.0:1784756232.399253:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1784756232.401572:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1784756232.401599:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784756232.401623:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.401634:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000146492fe/0x1782e2377f02113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784756232.401681:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784756232.401684:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784756232.401685:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756232.401686:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756232.401691:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756232.401692:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756232.401693:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784756232.401695:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784756232.401696:0:5775:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756232.401697:0:5775:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756232.401698:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756232.401700:0:5775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784756232.401702:0:5775:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1784756232.401704:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784756232.401706:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784756232.401707:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756232.401708:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756232.401708:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756232.401709:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756232.401710:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784756232.401711:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784756232.401711:0:5775:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756232.401712:0:5775:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756232.401713:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756232.401714:0:5775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784756232.401744:0:5775:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784756232.401757:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009dffa909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489911040:0@lo:253: 00000100:00100000:3.0:1784756232.402129:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756232.402165:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000004158e0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756232.402256:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911040 00000100:00100000:0.0:1784756232.402262:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911040 00000100:00100000:0.0:1784756232.402298:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756232.402304:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000728c9b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5775:x1871452489911040:12345-0@lo:253: 20000000:01000000:0.0:1784756232.402338:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784756232.402351:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784756232.409147:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784756232.409161:0:3318:0:(import.c:65:import_set_state_nolock()) 00000000ef1db580 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784756232.409169:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784756232.409173:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a9f5e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1871452489910784:0@lo:38: 20000000:01000000:2.0:1784756232.458632:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784756232.458679:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784756232.460084:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784756232.460090:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784756232.460118:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.460135:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f020f7 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.460143:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.460179:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756232.460206:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 12 pid: 5788 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756232.460221:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6c20ca7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489911168:0@lo:104: 00000100:00100000:3.0:1784756232.460280:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756232.460338:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set 000000008dd00d0a going to sleep for 11 seconds 00000100:00100000:1.0:1784756232.460410:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911168 00000100:00100000:1.0:1784756232.460418:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911168 00000100:00100000:1.0:1784756232.460492:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756232.460500:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e71d41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489911168:12345-0@lo:104: 00010000:00010000:1.0:1784756232.460511:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460561:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756232.460565:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e71d41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489911168:12345-0@lo:104: Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756232.460572:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756232.460606:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6c20ca7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489911168:0@lo:104: 00010000:00010000:1.0:1784756232.460625:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460641:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756232.460646:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460652:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008de5ad5f already unused, calling callback (000000009e5b591a) 10000000:00010000:1.0:1784756232.460655:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460661:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756232.460674:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756232.460680:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756232.460703:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460709:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756232.460723:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460730:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: 000000008de5ad5f/0x1782e2377f020f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020fe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.460745:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756232.460746:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756232.460748:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756232.460796:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86022db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489911296:0@lo:103: 00000100:00100000:1.0:1784756232.460842:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756232.460920:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911296 00000100:00100000:1.0:1784756232.460924:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911296 00010000:00010000:1.0:1784756232.460941:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 13 pid: 5788 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756232.460962:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756232.460979:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9de562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:3320:x1871452489911296:12345-0@lo:103: 00010000:00010000:1.0:1784756232.460989:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756232.460994:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 13 pid: 5788 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461008:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 13 pid: 5788 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461249:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036f0061c/0x1782e2377f020fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f020f7 expref: 13 pid: 5788 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461265:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461272:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784756232.461288:0:5779:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001196849s 00010000:00010000:1.0:1784756232.461292:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461299:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461304:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461310:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461315:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b00f425 already unused, calling callback (000000006e1afd58) 00010000:00010000:1.0:1784756232.461319:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461326:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461343:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461353:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756232.461378:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9de562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3320:x1871452489911296:12345-0@lo:103: Request processed in 411us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756232.461385:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784756232.461406:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461413:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756232.461419:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001b00f425/0x1782e2377f0212f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756232.463066:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86022db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489911296:0@lo:103: 00000100:00100000:3.0:1784756232.474229:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000728c9b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5775:x1871452489911040:12345-0@lo:253: Request processed in 71918us (72421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756232.474244:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756232.474327:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009dffa909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5775:1871452489911040:0@lo:253: 10000000:01000000:0.0:1784756232.474342:0:5775:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784756232.474345:0:5775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784756232.474347:0:5775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784756232.474348:0:5775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756232.474349:0:5775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756232.474350:0:5775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756232.474351:0:5775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756232.474352:0:5775:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784756232.474353:0:5775:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784756232.474355:0:5775:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756232.474356:0:5775:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756232.474357:0:5775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756232.474358:0:5775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784756232.474374:0:5775:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784756232.481378:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.482393:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756232.482687:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.483135:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756232.483326:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.483655:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756232.494274:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.495304:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756232.495602:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.496710:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756232.497718:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756232.498540:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784756232.562336:0:5775:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1784756232.594779:0:5775:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784756232.595167:0:5828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1784756232.603326:0:5827:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784756232.603332:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784756232.604390:0:5775:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784756232.604745:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784756232.605446:0:5775:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784756232.605454:0:5775:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784756232.605628:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756232.606711:0:5775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784756232.607423:0:5775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784756232.607458:0:5775:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784756232.609304:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784756232.609511:0:5775:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1784756232.613579:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1784756232.613729:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1784756232.613989:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784756232.614215:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784756232.614339:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784756232.614534:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784756232.614660:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784756232.614792:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784756232.615440:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784756232.616378:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784756232.616532:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784756232.616679:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784756232.617174:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784756232.617348:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784756232.618986:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784756232.619364:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784756232.619667:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784756232.619810:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784756232.620014:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784756232.620181:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784756232.620316:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784756232.620499:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784756232.620633:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784756232.620778:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784756232.624099:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784756232.624294:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784756232.624430:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784756232.624621:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784756232.624768:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784756232.624948:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784756232.625080:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784756232.625243:0:5775:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784756232.625410:0:5775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1784756232.652498:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784756232.690886:0:5775:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784756232.690924:0:5775:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff99d9c1db3988 00100000:10000000:1.0:1784756232.690931:0:5775:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784756232.693724:0:5775:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784756232.693744:0:5775:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784756232.693757:0:5775:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784756232.693780:0:5775:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1784756232.740262:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784756232.740333:0:5828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784756232.740348:0:5828:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784756233.204574:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756234.257068:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756235.292932:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784756236.179142:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784756236.179149:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b761808f800 from 3 10000000:01000000:1.0:1784756236.179152:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784756236.179193:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756236.179205:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756236.179214:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756236.179236:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c86022db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489911424:0@lo:101: 00000100:00100000:1.0:1784756236.179297:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756236.179349:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d4752e3 going to sleep for 11 seconds 00000100:00100000:3.0:1784756236.182688:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911424 00000100:00100000:3.0:1784756236.182702:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911424 00000100:00100000:3.0:1784756236.182753:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756236.182763:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ad917b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5792:x1871452489911424:12345-0@lo:101: 00010000:00010000:3.0:1784756236.182781:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756236.182808:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b00f425/0x1782e2377f0213d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02136 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756236.182834:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b00f425/0x1782e2377f0213d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02136 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756236.182846:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b00f425/0x1782e2377f0213d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02136 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756236.182854:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b00f425, rc 0) 00000100:00100000:3.0:1784756236.182925:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ad917b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489911424:12345-0@lo:101: Request processed in 164us (3628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756236.182932:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756236.182990:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c86022db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489911424:0@lo:101: 00010000:00010000:3.0:1784756236.183006:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756236.183015:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756236.183090:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6ee848d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489911552:0@lo:256: 00000100:00100000:3.0:1784756236.183126:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756236.183154:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000520ea5d0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756236.183168:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911552 00000100:00100000:3.0:1784756236.183177:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911552 00000100:00100000:3.0:1784756236.183198:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756236.183203:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5846b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489911552:12345-0@lo:256: 20000000:01000000:3.0:1784756236.183219:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784756236.183234:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784756236.183238:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784756236.183302:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5846b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489911552:12345-0@lo:256: Request processed in 98us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756236.183308:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756236.183336:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6ee848d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489911552:0@lo:256: 10000000:01000000:3.0:1784756236.183375:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784756236.183381:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756236.183388:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000217c4424/0x1782e2377f02136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756236.301700:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756237.325820:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756237.453756:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1784756237.453782:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784756237.453787:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784756237.453790:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ef1db580 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784756237.453802:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ef1db580 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1784756237.453822:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf28c733 x1871452489911808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784756237.453853:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf28c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1871452489911808:0@lo:38: 00000100:00100000:2.0:1784756237.453927:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756237.454326:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003821288a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489911680:0@lo:400: 00000100:00100000:3.0:1784756237.454359:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756237.454400:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911808 00000100:00100000:3.0:1784756237.454407:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911808 00000100:00100000:3.0:1784756237.454438:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784756237.454444:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e1bcf6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1871452489911808:12345-0@lo:38: 00000100:00100000:2.0:1784756237.454579:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911680 00000100:00100000:2.0:1784756237.454584:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911680 00000100:00100000:2.0:1784756237.454613:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756237.454619:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b220874b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3322:x1871452489911680:12345-0@lo:400: 00000100:00100000:2.0:1784756237.454661:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b220874b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3322:x1871452489911680:12345-0@lo:400: Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756237.454668:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756237.454713:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003821288a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489911680:0@lo:400: 00010000:00080000:3.0:1784756237.454766:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1784756237.454799:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1782e2377f02144 00000004:00100000:3.0:1784756237.454849:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784756237.454957:0:5796:0:(import.c:65:import_set_state_nolock()) 00000000180bcae8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756237.455000:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e1bcf6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1871452489911808:12345-0@lo:38: Request processed in 555us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756237.455007:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756237.455104:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf28c733 x1871452489911808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784756237.455116:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784756237.455121:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784756237.455126:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784756237.455128:0:3318:0:(import.c:65:import_set_state_nolock()) 00000000ef1db580 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784756237.455137:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf28c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1871452489911808:0@lo:38: 00000001:02000400:0.0:1784756237.566397:0:6070:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784756238.352232:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756239.373756:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756240.408344:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756241.429315:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784756242.303202:0:6272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb8664de0 20000000:00000080:3.0:1784756242.303219:0:6272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b76116ef800 uarg=0000000000000000 20000000:01000000:3.0:1784756242.303250:0:6272:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784756242.303256:0:6272:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784756242.303262:0:6272:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784756242.303458:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784756242.303494:0:6272:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784756242.312253:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756242.313636:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784756242.313784:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784756242.313838:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784756242.313856:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784756242.313875:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.313893:0:6272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.313900:0:6272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.313938:0:6272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.313952:0:6272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756242.313966:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6ee848d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1871452489911936:0@lo:104: 00000100:00100000:3.0:1784756242.314057:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756242.314110:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 000000002ebdfb52 going to sleep for 11 seconds 00000100:00100000:0.0:1784756242.314716:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489911936 00000100:00100000:0.0:1784756242.314906:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489911936 00000100:00100000:0.0:1784756242.314991:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756242.315000:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f296b065 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:6272:x1871452489911936:12345-0@lo:104: 00010000:00010000:0.0:1784756242.315016:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756242.315109:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756242.315114:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f296b065 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:6272:x1871452489911936:12345-0@lo:104: Request processed in 116us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756242.315121:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784756242.315186:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756242.315192:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.315200:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4ad2667 already unused, calling callback (000000009e5b591a) 10000000:00010000:2.0:1784756242.315203:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.315210:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756242.315217:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756242.315223:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784756242.315253:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.315260:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756242.315279:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.315286:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: 00000000c4ad2667/0x1782e2377f02105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0210c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.315323:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756242.315325:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756242.315336:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756242.315350:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf28c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489912064:0@lo:103: 00000100:00100000:2.0:1784756242.315384:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756242.316971:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912064 00000100:00100000:1.0:1784756242.316981:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912064 00010000:00010000:1.0:1784756242.317014:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 12 pid: 5790 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756242.317067:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784756242.317075:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003821288a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3322:x1871452489912064:12345-0@lo:103: 00010000:00010000:1.0:1784756242.317088:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756242.317093:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 12 pid: 5790 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317170:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 12 pid: 5790 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317190:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317198:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317212:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317219:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317224:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317230:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317235:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000baddcb19 already unused, calling callback (000000006e1afd58) 00010000:00010000:1.0:1784756242.317238:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317244:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.317251:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756242.318199:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756242.318493:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003821288a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3322:x1871452489912064:12345-0@lo:103: Request processed in 1418us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756242.318505:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784756242.319662:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf28c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489912064:0@lo:103: 00010000:00010000:3.0:1784756242.319883:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046da69a6/0x1782e2377f0210c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02105 expref: 11 pid: 5790 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756242.319899:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6ee848d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1871452489911936:0@lo:104: 00010000:00010000:3.0:1784756242.319917:0:6272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.319925:0:6272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.319930:0:6272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756242.319934:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000baddcb19/0x1782e2377f0214b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756242.445668:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756242.573822:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756242.574344:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099b3c5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489912192:0@lo:400: 00000100:00100000:3.0:1784756242.574420:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756242.574704:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912192 00000100:00100000:0.0:1784756242.574713:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912192 00000100:00100000:0.0:1784756242.574865:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756242.574873:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ee848d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489912192:12345-0@lo:400: 00000100:00100000:0.0:1784756242.575003:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ee848d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489912192:12345-0@lo:400: Request processed in 130us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756242.575011:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784756242.578051:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000099b3c5e2 x1871452489912192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756242.578071:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099b3c5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489912192:0@lo:400: 00010000:00010000:1.0:1784756243.470595:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756244.505907:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784756244.687661:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756244.687670:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b761808f800 from 1 10000000:01000000:0.0:1784756244.687674:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756244.687720:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000e0fec874/0x1782e2377f02152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.687749:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000e0fec874/0x1782e2377f02152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.687758:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000e0fec874/0x1782e2377f02152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756244.687781:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912320:0@lo:101: 00000100:00100000:0.0:1784756244.687846:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756244.687896:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000169ebca8 going to sleep for 11 seconds 00000100:00100000:0.0:1784756244.687920:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912320 00000100:00100000:0.0:1784756244.687926:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912320 00000100:00100000:0.0:1784756244.687973:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756244.687981:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000866c00f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:5792:x1871452489912320:12345-0@lo:101: 00010000:00010000:0.0:1784756244.687993:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756244.688016:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036f0061c/0x1782e2377f02159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02152 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.688037:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036f0061c/0x1782e2377f02159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02152 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.688046:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036f0061c/0x1782e2377f02159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02152 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.688054:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036f0061c, rc 0) 00000100:00100000:0.0:1784756244.688089:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000866c00f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489912320:12345-0@lo:101: Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756244.688096:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756244.688138:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912320:0@lo:101: 00010000:00010000:0.0:1784756244.688156:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000e0fec874/0x1782e2377f02152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756244.688162:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000e0fec874/0x1782e2377f02152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756244.688207:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912448:0@lo:501: 00000100:00100000:0.0:1784756244.688229:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756244.688242:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000169ebca8 going to sleep for 11 seconds 00000100:00100000:0.0:1784756244.688253:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912448 00000100:00100000:0.0:1784756244.688256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912448 00000100:00100000:0.0:1784756244.688274:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756244.688279:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006791fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489912448:12345-0@lo:501: 00000100:00100000:0.0:1784756244.688517:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006791fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489912448:12345-0@lo:501: Request processed in 238us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756244.688523:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756244.688794:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912448:0@lo:501: 00000100:00100000:0.0:1784756244.688819:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912576:0@lo:503: 00000100:00100000:0.0:1784756244.688855:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756244.688875:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000169ebca8 going to sleep for 11 seconds 00000100:00100000:0.0:1784756244.688887:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912576 00000100:00100000:0.0:1784756244.688890:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912576 00000100:00100000:0.0:1784756244.688912:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756244.688917:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e638891b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489912576:12345-0@lo:503: 00000100:00100000:0.0:1784756244.689065:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e638891b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489912576:12345-0@lo:503: Request processed in 148us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756244.689072:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756244.689114:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489912576:0@lo:503: 00000100:00100000:0.0:1784756244.689271:0:6372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6372:1871452489912704:0@lo:502: 00000100:00100000:0.0:1784756244.689302:0:6372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756244.689320:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912704 00000100:00100000:0.0:1784756244.689323:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912704 00000100:00100000:0.0:1784756244.689341:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756244.689345:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000607926e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6372:x1871452489912704:12345-0@lo:502: 00000100:00100000:0.0:1784756244.689452:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000607926e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6372:x1871452489912704:12345-0@lo:502: Request processed in 107us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756244.689459:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756244.689512:0:6372:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bec0bff8 going to sleep for 11 seconds 00000100:00100000:0.0:1784756244.689524:0:6372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064f59870 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6372:1871452489912704:0@lo:502: 00000020:01000000:0.0:1784756244.690835:0:6372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756244.690851:0:6372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756244.690853:0:6372:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784756244.690863:0:6372:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b761808f800 00000020:00000080:0.0:1784756244.690865:0:6372:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784756244.691351:0:6372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6372:1871452489912832:0@lo:502: 00000100:00100000:0.0:1784756244.691409:0:6372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756244.691448:0:6372:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76081799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756244.691732:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912832 00000100:00100000:2.0:1784756244.691739:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912832 00000100:00100000:2.0:1784756244.691789:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784756244.691798:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6372:x1871452489912832:12345-0@lo:502: 00000100:00100000:2.0:1784756244.692013:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6372:x1871452489912832:12345-0@lo:502: Request processed in 216us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756244.692021:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756244.692235:0:6372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6372:1871452489912832:0@lo:502: 00000020:01000000:0.0:1784756244.692259:0:6372:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756244.692264:0:6372:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756244.692267:0:6372:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784756244.692271:0:6372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784756244.692432:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784756244.692452:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756244.692494:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756244.692506:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756245.518760:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756246.543641:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756247.565646:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756247.696396:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489913088:0@lo:400: 00000100:00100000:2.0:1784756247.696495:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756247.696583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913088 00000100:00100000:2.0:1784756247.696591:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913088 00000100:00100000:2.0:1784756247.696634:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784756247.696644:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489913088:12345-0@lo:400: 00000100:00100000:2.0:1784756247.696723:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489913088:12345-0@lo:400: Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756247.696731:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756247.696775:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b7608084380 x1871452489913088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756247.696790:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489913088:0@lo:400: 00000100:00100000:1.0:1784756247.696913:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489912960:0@lo:400: 00000100:00100000:1.0:1784756247.696957:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756247.697292:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489912960 00000100:00100000:2.0:1784756247.697297:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489912960 00000100:00100000:2.0:1784756247.697331:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784756247.697339:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3320:x1871452489912960:12345-0@lo:400: 00000100:00100000:2.0:1784756247.697380:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3320:x1871452489912960:12345-0@lo:400: Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756247.697386:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784756247.697579:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489912960:0@lo:400: 00000020:01000004:0.0:1784756247.787903:0:6596:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784756247.787914:0:6596:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784756247.788071:0:6596:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b760fc26000 00000020:01000004:0.0:1784756247.788093:0:6596:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784756247.788107:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784756247.788122:0:6596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b760819b380) 00000020:00000080:0.0:1784756247.788139:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784756247.810290:0:6596:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784756247.810931:0:6596:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784756247.851164:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784756247.866159:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784756247.866203:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784756247.866417:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784756247.866445:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784756247.866960:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784756247.867094:0:6596:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784756247.867123:0:6596:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1782e2377f02167 00000020:01000004:3.0:1784756247.867131:0:6596:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784756247.867155:0:6596:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784756247.867159:0:6596:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784756247.867166:0:6596:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784756247.867170:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784756247.867182:0:6596:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b76083d4d40) 00000020:00000080:3.0:1784756247.867193:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1784756247.870443:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784756247.870660:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784756247.870667:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784756247.873156:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784756247.873168:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784756247.874216:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784756247.874230:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784756247.879611:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756247.880600:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784756247.880607:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784756247.881499:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784756247.881510:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1784756247.945113:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784756247.945359:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784756247.945367:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784756247.964077:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784756247.964095:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784756247.968861:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784756247.968875:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784756247.974930:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756247.975150:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784756247.975164:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784756247.975746:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784756247.975754:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784756248.046290:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756248.046598:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784756248.046695:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784756248.048062:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784756248.048075:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784756248.048558:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784756248.048584:0:6596:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1784756248.048591:0:6596:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784756248.077428:0:6596:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784756248.077732:0:6596:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1784756248.077737:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784756248.077739:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.077740:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.077741:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756248.077742:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.077744:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.077745:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.077747:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756248.077748:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756248.077750:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.077752:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784756248.077756:0:6596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1784756248.077759:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784756248.077760:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.077762:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.077763:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756248.077764:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.077765:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.077767:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.077775:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756248.077776:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756248.077777:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.077778:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784756248.077820:0:6596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784756248.077845:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489913216:0@lo:253: 00000100:00100000:1.0:1784756248.077941:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.078015:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611714cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.078182:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913216 00000100:00100000:2.0:1784756248.078191:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913216 00000100:00100000:2.0:1784756248.078255:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756248.078266:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489913216:12345-0@lo:253: 20000000:01000000:2.0:1784756248.078305:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784756248.078310:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1784756248.078315:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1784756248.078319:0:5788:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1784756248.079705:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784756248.080011:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1784756248.080027:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1784756248.080070:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1784756248.080079:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1784756248.080111:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1784756248.080174:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1784756248.080758:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1784756248.080779:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:2.0:1784756248.080782:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:2.0:1784756248.080924:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1784756248.080932:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784756248.080995:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1784756248.081006:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:2.0:1784756248.081041:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1784756248.081050:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784756248.081080:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1784756248.081139:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1784756248.082387:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1784756248.082413:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:2.0:1784756248.082415:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:2.0:1784756248.082448:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1784756248.082455:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784756248.082597:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1784756248.082612:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:2.0:1784756248.082662:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1784756248.082673:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784756248.082706:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1784756248.082744:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1784756248.082761:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784756248.082764:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784756248.082767:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784756248.082779:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784756248.082782:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784756248.083083:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784756248.083087:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784756248.083923:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1784756248.083998:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1784756248.084073:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1784756248.084403:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1784756248.084439:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1784756248.084637:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1784756248.084650:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784756248.084652:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784756248.085221:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1784756248.085276:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1784756248.085328:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1784756248.085726:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1784756248.085769:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1784756248.085881:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1784756248.085895:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784756248.085897:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784756248.089617:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1784756248.090271:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1784756248.090319:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1784756248.090390:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1784756248.090408:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784756248.090424:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784756248.090435:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784756248.090457:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090510:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02087 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090519:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090525:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02113 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090531:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090571:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090586:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 12 pid: 5788 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.090601:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913344:0@lo:104: 00000100:00100000:2.0:1784756248.090682:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756248.090738:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.090748:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.090756:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913472:0@lo:104: 00000100:00100000:2.0:1784756248.090786:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.090906:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913344 00000100:00100000:0.0:1784756248.090913:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913344 00000100:00100000:0.0:1784756248.090946:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913472 00000100:00100000:0.0:1784756248.090948:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913472 00000100:00100000:0.0:1784756248.090961:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756248.090979:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:5788:x1871452489913344:12345-0@lo:104: 00010000:00010000:0.0:1784756248.090992:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.091047:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756248.091052:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:5788:x1871452489913344:12345-0@lo:104: Request processed in 85us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.091059:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756248.091080:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784756248.091085:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5788:x1871452489913472:12345-0@lo:104: 00010000:00010000:0.0:1784756248.091093:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.091126:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784756248.091131:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5788:x1871452489913472:12345-0@lo:104: Request processed in 46us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.091137:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784756248.091262:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784756248.091269:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091276:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756248.091280:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091289:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756248.091296:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.091301:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756248.091378:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091384:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756248.091401:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091407:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f62a00/0x1782e2377f02113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0211a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091418:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784756248.091421:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091425:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600030200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756248.091428:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.091434:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756248.091440:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.091444:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756248.092748:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.092787:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.092805:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 12 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.092817:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913728:0@lo:104: 00000100:00100000:2.0:1784756248.092856:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.092881:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7618a969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.092903:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913344:0@lo:104: 00000100:00100000:2.0:1784756248.092912:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913472:0@lo:104: 00000100:00100000:1.0:1784756248.093094:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913728 00000100:00100000:1.0:1784756248.093101:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913728 00000100:00100000:1.0:1784756248.093145:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784756248.093161:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5788:x1871452489913728:12345-0@lo:104: 00010000:00010000:1.0:1784756248.093172:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.093217:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756248.093224:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5788:x1871452489913728:12345-0@lo:104: Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756248.093231:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784756248.093318:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784756248.093351:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1871452489913728:0@lo:104: 00010000:00010000:2.0:1784756248.093373:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.093653:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756248.093656:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756248.093658:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.093696:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.093704:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600030800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:2.0:1784756248.093708:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.093716:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756248.093724:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756248.093736:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756248.093937:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.093944:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756248.093982:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.093999:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f020a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f020aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094013:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756248.094015:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756248.094017:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756248.094032:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489913600:0@lo:103: 00000100:00100000:3.0:1784756248.094069:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.094130:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756248.094138:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489913856:0@lo:103: 00000100:00100000:3.0:1784756248.094173:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.094206:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913600 00000100:00100000:3.0:1784756248.094211:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913600 00010000:00010000:3.0:1784756248.094230:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 13 pid: 5788 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.094249:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913856 00000100:00100000:3.0:1784756248.094252:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913856 00010000:00010000:3.0:1784756248.094261:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 14 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.094273:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756248.094279:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:3322:x1871452489913600:12345-0@lo:103: 00010000:00010000:3.0:1784756248.094290:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756248.094295:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 14 pid: 5788 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094305:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 14 pid: 5788 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094325:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600030a00/0x1782e2377f0211a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02113 expref: 14 pid: 5788 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094337:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756248.094368:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:3322:x1871452489913600:12345-0@lo:103: Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.094374:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756248.094393:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784756248.094399:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3320:x1871452489913856:12345-0@lo:103: 00010000:00010000:3.0:1784756248.094406:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756248.094410:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094419:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094429:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7609563000/0x1782e2377f020aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f020a3 expref: 12 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.094438:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756248.094463:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:3320:x1871452489913856:12345-0@lo:103: Request processed in 64us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.094498:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784756248.094531:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489913600:0@lo:103: 00000100:00100000:3.0:1784756248.094552:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489913856:0@lo:103: 00010000:00010000:2.0:1784756248.094790:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.094808:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756248.094829:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.094836:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7600030800/0x1782e2377f02087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0208e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.094849:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.094851:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.094852:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756248.094941:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756248.094952:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489913984:0@lo:103: 00000100:00100000:1.0:1784756248.095010:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.095311:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489913984 00000100:00100000:2.0:1784756248.095316:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489913984 00010000:00010000:2.0:1784756248.095338:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.095368:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756248.095376:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:3319:x1871452489913984:12345-0@lo:103: 00010000:00010000:2.0:1784756248.095385:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756248.095389:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095399:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095411:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ef000/0x1782e2377f0208e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02087 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095438:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095446:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095462:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095501:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095509:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095515:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095521:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62600 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756248.095525:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095532:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095550:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.095980:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756248.096025:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:3319:x1871452489913984:12345-0@lo:103: Request processed in 649us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.096041:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756248.096084:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489913984:0@lo:103: 00010000:00010000:1.0:1784756248.096248:0:5788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.096257:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.096272:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62600/0x1782e2377f02175 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784756248.096288:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784756248.160125:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:6596:x1871452489913216:12345-0@lo:253: Request processed in 81851us (82173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.160141:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784756248.160614:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489913216:0@lo:253: 10000000:01000000:1.0:1784756248.160629:0:6596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784756248.160632:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784756248.160634:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.160635:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.160636:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784756248.160638:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.160639:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.160640:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.160642:0:6596:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784756248.160644:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.160645:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784756248.160668:0:6596:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b760fc26000 from lustre-OST0000 10000000:01000000:1.0:1784756248.160696:0:6596:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784756248.160699:0:6596:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784756248.160707:0:6596:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b76104c8000 local copy 10000000:01000000:1.0:1784756248.160712:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784756248.160753:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.160765:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.160776:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756248.160795:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914112:0@lo:101: 00000100:00100000:1.0:1784756248.160866:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.160929:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1784756248.161145:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914112 00000100:00100000:0.0:1784756248.161152:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914112 00000100:00100000:0.0:1784756248.161202:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756248.161211:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:6596:x1871452489914112:12345-0@lo:101: 00010000:00010000:0.0:1784756248.161224:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756248.161237:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600030800/0x1782e2377f02183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0217c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.161262:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600030800/0x1782e2377f02183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0217c expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.161272:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600030800/0x1782e2377f02183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0217c expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.161289:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600030800, rc 0) 00000100:00100000:0.0:1784756248.161331:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:6596:x1871452489914112:12345-0@lo:101: Request processed in 120us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.161337:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784756248.161980:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914112:0@lo:101: 00010000:00010000:1.0:1784756248.162000:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.162010:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756248.162154:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914240:0@lo:501: 00000100:00100000:1.0:1784756248.162188:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.162224:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.162250:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914240 00000100:00100000:2.0:1784756248.162255:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914240 00000100:00100000:2.0:1784756248.162294:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784756248.162302:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:6596:x1871452489914240:12345-0@lo:501: 00000100:00100000:2.0:1784756248.162540:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:6596:x1871452489914240:12345-0@lo:501: Request processed in 237us (350us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784756248.162547:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756248.162685:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914240:0@lo:501: 10000000:01000000:1.0:1784756248.162699:0:6596:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784756248.162725:0:6596:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784756248.162731:0:6596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.162740:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.162747:0:6596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.162774:0:6596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784756248.162795:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b760fc26000 10000000:01000000:3.0:1784756248.162861:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784756248.162867:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b76104c8000 10000000:01000000:3.0:1784756248.162877:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784756248.162881:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8b76104c8000 from 1 10000000:01000000:3.0:1784756248.162884:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784756248.162907:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.162914:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.162922:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.162934:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914368:0@lo:101: 00000100:00100000:3.0:1784756248.162962:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.162998:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760960d480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756248.163035:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914368 00000100:00100000:0.0:1784756248.163041:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914368 00010000:00010000:2.0:1784756248.163048:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756248.163053:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.163060:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609563a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:2.0:1784756248.163064:0:6614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.163073:0:6614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756248.163080:0:6614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.163080:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756248.163086:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:6596:x1871452489914368:12345-0@lo:101: 00010000:00010000:0.0:1784756248.163094:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:01000000:2.0:1784756248.163095:0:6614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784756248.163105:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600030a00/0x1782e2377f02191 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0218a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.163113:0:6614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.163121:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600030a00/0x1782e2377f02191 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0218a expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.163123:0:6614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756248.163130:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600030a00/0x1782e2377f02191 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0218a expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.163138:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600030a00, rc 0) 00010000:00010000:2.0:1784756248.163151:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.163166:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914368:12345-0@lo:101: Request processed in 80us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1784756248.163169:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f0217c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f02183 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.163172:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784756248.163190:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756248.163200:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489914496:0@lo:103: 00000100:00100000:2.0:1784756248.163227:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756248.163260:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.163262:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756248.163264:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756248.163373:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914368:0@lo:101: 00010000:00010000:3.0:1784756248.163387:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02191 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.163389:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914496 00000100:00100000:0.0:1784756248.163393:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914496 00010000:00010000:3.0:1784756248.163397:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02191 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.163416:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784756248.163426:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02191 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.163426:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756248.163433:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:3322:x1871452489914496:12345-0@lo:103: 00010000:00010000:3.0:1784756248.163434:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421ee000/0x1782e2377f0218a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02191 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.163441:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:0.0:1784756248.163443:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:3.0:1784756248.163448:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784756248.163452:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784756248.163454:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784756248.163454:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600030800/0x1782e2377f02183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1782e2377f0217c expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163487:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163494:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163502:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.163507:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756248.163514:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914624:0@lo:101: 00000100:00100000:3.0:1784756248.163536:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.163536:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:3322:x1871452489914496:12345-0@lo:103: Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.163543:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756248.163554:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914624 00000100:00100000:3.0:1784756248.163557:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914624 00000100:00100000:3.0:1784756248.163578:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756248.163583:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489914496:0@lo:103: 00000100:00100000:3.0:1784756248.163584:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+10:6596:x1871452489914624:12345-0@lo:101: 00010000:00010000:3.0:1784756248.163590:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756248.163598:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02198 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163611:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02198 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163619:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02198 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163626:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b76421ee600, rc 0) 00000100:00100000:3.0:1784756248.163648:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914624:12345-0@lo:101: Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.163659:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784756248.163692:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760960d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756248.163710:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914624:0@lo:101: 00010000:00010000:3.0:1784756248.163720:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.163728:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.163788:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914752:0@lo:501: 00000100:00100000:3.0:1784756248.163813:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.163833:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760960d480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756248.163882:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914752 00000100:00100000:0.0:1784756248.163887:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914752 00000100:00100000:0.0:1784756248.163917:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756248.163923:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914752:12345-0@lo:501: 00000100:00100000:0.0:1784756248.164137:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914752:12345-0@lo:501: Request processed in 213us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.164144:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784756248.164304:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914752:0@lo:501: 00000100:00100000:3.0:1784756248.164335:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914880:0@lo:503: 00000100:00100000:3.0:1784756248.164373:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.164397:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760960d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784756248.164443:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489914880 00000100:00100000:1.0:1784756248.164449:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489914880 00000100:00100000:1.0:1784756248.164518:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784756248.164525:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914880:12345-0@lo:503: 00000100:00100000:2.0:1784756248.164733:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489914880:12345-0@lo:503: Request processed in 208us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.164740:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784756248.164810:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489914880:0@lo:503: 00000040:00080000:3.0:1784756248.165113:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784756248.165205:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915008:0@lo:502: 00000100:00100000:3.0:1784756248.165238:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.165273:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763c564f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756248.165624:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915008 00000100:00100000:0.0:1784756248.165631:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915008 00000100:00100000:0.0:1784756248.165673:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756248.165681:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489915008:12345-0@lo:502: 00000100:00100000:0.0:1784756248.165896:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489915008:12345-0@lo:502: Request processed in 215us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.165904:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784756248.166019:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915008:0@lo:502: 00000040:00080000:3.0:1784756248.166423:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784756248.166554:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784756248.166598:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784756248.166655:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784756248.166768:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784756248.166802:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784756248.166839:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915136:0@lo:502: 00000100:00100000:3.0:1784756248.166883:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.168386:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760960d480 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.170796:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915136 00000100:00100000:2.0:1784756248.170812:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915136 00000100:00100000:2.0:1784756248.170925:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756248.170937:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489915136:12345-0@lo:502: 00000100:00100000:2.0:1784756248.171242:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489915136:12345-0@lo:502: Request processed in 307us (4358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.171250:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756248.171346:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915136:0@lo:502: 00000040:00080000:0.0:1784756248.171618:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784756248.171636:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1784756248.172610:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784756248.172621:0:6616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1784756248.172629:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756248.172631:0:6616:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1784756248.172638:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784756248.172653:0:6616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b7608198000) 00000020:00000080:0.0:1784756248.172676:0:6616:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784756248.172682:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784756248.172754:0:6616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b760fc26000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1784756248.172762:0:6616:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784756248.172769:0:6616:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1782e2377f021ad 00010000:00010000:1.0:1784756248.185333:0:6616:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1784756248.187723:0:6616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1784756248.196102:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1784756248.197661:0:6616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784756248.212380:0:6616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784756248.212888:0:6616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1784756248.223046:0:6616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784756248.223062:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756248.223069:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756248.223072:0:6616:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784756248.223075:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756248.223078:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756248.223080:0:6616:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756248.223083:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756248.223084:0:6616:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784756248.223150:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756248.223154:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756248.223156:0:6616:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756248.223159:0:6616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784756248.225897:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1784756248.225939:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784756248.225982:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.225994:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756248.226002:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b760fc26000 from 1 10000000:01000000:2.0:1784756248.226005:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756248.226043:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.226052:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.226062:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.226084:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915264:0@lo:101: 00000100:00100000:2.0:1784756248.226156:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.226202:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637d5ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756248.228023:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915264 00000100:00100000:0.0:1784756248.228047:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915264 00000100:00100000:0.0:1784756248.228273:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756248.228285:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:6596:x1871452489915264:12345-0@lo:101: 00010000:00010000:0.0:1784756248.228303:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756248.228321:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f021b4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.228347:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f021b4 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.228359:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021b4 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756248.228368:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600030800, rc 0) 00000100:00100000:0.0:1784756248.228447:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915264:12345-0@lo:101: Request processed in 164us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756248.228454:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784756248.228588:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915264:0@lo:101: 00010000:00010000:1.0:1784756248.228607:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.228618:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756248.228753:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915392:0@lo:501: 00000100:00100000:1.0:1784756248.228816:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.236730:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cda80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.238248:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915392 00000100:00100000:2.0:1784756248.238260:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915392 00000100:00100000:2.0:1784756248.238305:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784756248.238315:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915392:12345-0@lo:501: 00000100:00100000:2.0:1784756248.238660:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915392:12345-0@lo:501: Request processed in 346us (9843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.238669:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784756248.239061:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915392:0@lo:501: 00000100:00100000:1.0:1784756248.239122:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915520:0@lo:503: 00000100:00100000:1.0:1784756248.239167:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.239194:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cda80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.239282:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915520 00000100:00100000:2.0:1784756248.239287:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915520 00000100:00100000:2.0:1784756248.239321:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784756248.239334:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915520:12345-0@lo:503: 00000100:00100000:2.0:1784756248.240053:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915520:12345-0@lo:503: Request processed in 717us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.240062:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756248.242172:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915520:0@lo:503: 00000040:00080000:0.0:1784756248.242711:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756248.242901:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915648:0@lo:502: 00000100:00100000:0.0:1784756248.242986:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.243034:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.243109:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915648 00000100:00100000:2.0:1784756248.243115:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915648 00000100:00100000:2.0:1784756248.243195:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784756248.243206:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915648:12345-0@lo:502: 00000100:00100000:2.0:1784756248.243426:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915648:12345-0@lo:502: Request processed in 221us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.243434:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784756248.243518:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915648:0@lo:502: 00000040:00080000:0.0:1784756248.246130:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784756248.246232:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784756248.246282:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915776:0@lo:502: 00000100:00100000:0.0:1784756248.246372:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.246688:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191600 going to sleep for 11 seconds 00000100:00100000:3.0:1784756248.247242:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915776 00000100:00100000:3.0:1784756248.247252:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915776 00000100:00100000:3.0:1784756248.247298:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784756248.247307:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915776:12345-0@lo:502: 00000100:00100000:3.0:1784756248.247630:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915776:12345-0@lo:502: Request processed in 322us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.247639:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756248.248034:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915776:0@lo:502: 00000040:00080000:0.0:1784756248.248202:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784756248.248219:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784756248.249138:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756248.249150:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756248.249152:0:6620:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784756248.249159:0:6620:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b760fc26000 00000020:00000080:3.0:1784756248.249161:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784756248.249182:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756248.249186:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756248.249187:0:6620:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784756248.249190:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784756248.249349:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784756248.249375:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756248.249438:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.249451:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.249657:0:6596:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784756248.249660:0:6596:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b760fc26000 10000000:01000000:3.0:1784756248.249663:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b760fc26000 10000000:01000000:3.0:1784756248.249667:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784756248.249673:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b760fc26000 from 1 10000000:01000000:3.0:1784756248.249676:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784756248.249713:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.249734:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.249745:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.249766:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915904:0@lo:101: 00000100:00100000:3.0:1784756248.249930:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.249982:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b762c8dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.250043:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489915904 00000100:00100000:2.0:1784756248.250049:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489915904 00000100:00100000:2.0:1784756248.250098:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784756248.250107:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489915904:12345-0@lo:101: 00010000:00010000:2.0:1784756248.250123:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756248.250140:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f021c2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.250168:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f021c2 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.250192:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021c2 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756248.250202:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62a00, rc 0) 00000100:00100000:2.0:1784756248.250319:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489915904:12345-0@lo:101: Request processed in 212us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.250326:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784756248.250778:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489915904:0@lo:101: 00010000:00010000:1.0:1784756248.250892:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.250903:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756248.251115:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916032:0@lo:501: 00000100:00100000:0.0:1784756248.251154:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.251221:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191600 going to sleep for 11 seconds 00000100:00100000:1.0:1784756248.251261:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916032 00000100:00100000:1.0:1784756248.251267:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916032 00000100:00100000:1.0:1784756248.251335:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784756248.251344:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916032:12345-0@lo:501: 00000100:00100000:1.0:1784756248.251618:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916032:12345-0@lo:501: Request processed in 275us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756248.251626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784756248.251706:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916032:0@lo:501: 00000100:00100000:0.0:1784756248.251738:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916160:0@lo:503: 00000100:00100000:0.0:1784756248.251778:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.252055:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191600 going to sleep for 11 seconds 00000100:00100000:3.0:1784756248.252111:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916160 00000100:00100000:3.0:1784756248.252116:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916160 00000100:00100000:2.0:1784756248.252151:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784756248.252161:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916160:12345-0@lo:503: 00000100:00100000:2.0:1784756248.252323:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916160:12345-0@lo:503: Request processed in 164us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.252330:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784756248.252423:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916160:0@lo:503: 00000040:00080000:0.0:1784756248.252715:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756248.252789:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916288:0@lo:502: 00000100:00100000:0.0:1784756248.252938:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756248.252974:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756248.253058:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916288 00000100:00100000:2.0:1784756248.253063:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916288 00000100:00100000:2.0:1784756248.253086:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784756248.253094:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916288:12345-0@lo:502: 00000100:00100000:2.0:1784756248.253274:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916288:12345-0@lo:502: Request processed in 182us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.253282:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784756248.253630:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916288:0@lo:502: 00000040:00080000:0.0:1784756248.254014:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784756248.254079:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784756248.254116:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784756248.254164:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784756248.254203:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784756248.254252:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784756248.254289:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784756248.254325:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784756248.254385:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784756248.254425:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784756248.254459:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784756248.254560:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784756248.254608:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784756248.254646:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784756248.254698:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784756248.254737:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784756248.254774:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784756248.255580:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784756248.255621:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784756248.255648:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784756248.255709:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784756248.255748:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784756248.255781:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784756248.255931:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784756248.255980:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784756248.256025:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784756248.256074:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784756248.256110:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784756248.256165:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916416:0@lo:502: 00000100:00100000:2.0:1784756248.256239:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.256330:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637d5a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756248.256540:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916416 00000100:00100000:3.0:1784756248.256549:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916416 00000100:00100000:3.0:1784756248.256606:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784756248.256616:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916416:12345-0@lo:502: 00000100:00100000:3.0:1784756248.257013:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916416:12345-0@lo:502: Request processed in 397us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.257021:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784756248.257163:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916416:0@lo:502: 00000040:00080000:0.0:1784756248.257258:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1784756248.257271:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784756248.258069:0:6621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784756248.258086:0:6621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b76083d19c0) 00000020:00000080:3.0:1784756248.258109:0:6621:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1784756248.258343:0:6621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b760fc26000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784756248.258347:0:6621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b760fc26000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784756248.258350:0:6621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b760fc26000 3 00010000:00080000:3.0:1784756248.258380:0:6621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b763f81f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1784756248.260337:0:6621:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1784756248.260446:0:6621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784756248.267192:0:6621:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784756248.267243:0:6621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1782e2377f021d7 00000100:00080000:3.0:1784756248.267256:0:6621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784756248.267262:0:6621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b763f81f000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1784756248.267309:0:6621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b7633c97800 x1871452489916544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784756248.267341:0:6621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784756248.267527:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1871452489916544:0@lo:38: 00000100:00100000:2.0:1784756248.267608:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.267681:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916544 00000100:00100000:2.0:1784756248.267688:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916544 00000100:00100000:2.0:1784756248.267728:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784756248.267737:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3318:x1871452489916544:12345-0@lo:38: 00010000:00080000:2.0:1784756248.267769:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1784756248.267897:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1782e2377f021de 00000004:00100000:2.0:1784756248.267921:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784756248.267986:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8b763f970800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784756248.268048:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1871452489916544:12345-0@lo:38: Request processed in 310us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.268057:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784756248.268107:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b7633c97800 x1871452489916544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756248.268118:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784756248.268125:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784756248.268132:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784756248.268137:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784756248.268139:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8b763f81f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784756248.268145:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1871452489916544:0@lo:38: 00000040:00080000:2.0:1784756248.268446:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1784756248.271329:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1784756248.271374:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784756248.271401:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.271414:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784756248.271500:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784756248.271508:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.271509:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.271510:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756248.271512:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.271513:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.271514:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.271516:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756248.271517:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756248.271519:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.271520:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784756248.271524:0:6596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784756248.271526:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784756248.271528:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.271529:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.271530:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756248.271530:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.271531:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.271532:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.271533:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756248.271534:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756248.271535:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.271536:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784756248.271564:0:6596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784756248.271581:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916672:0@lo:253: 00000100:00100000:1.0:1784756248.271649:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756248.271687:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1784756248.271782:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916672 00000100:00100000:3.0:1784756248.271789:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916672 00000100:00100000:3.0:1784756248.271842:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784756248.271852:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6596:x1871452489916672:12345-0@lo:253: 20000000:01000000:3.0:1784756248.271879:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784756248.271891:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784756248.276619:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756248.276642:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489916800:0@lo:400: 00000100:00100000:0.0:1784756248.276716:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756248.277171:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916800 00000100:00100000:2.0:1784756248.277181:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916800 00000100:00100000:2.0:1784756248.277234:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784756248.277243:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489916800:12345-0@lo:400: 00000100:00100000:2.0:1784756248.277299:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489916800:12345-0@lo:400: Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.277306:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784756248.277350:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b76083b1c00 x1871452489916800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756248.277364:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489916800:0@lo:400: 20000000:01000000:2.0:1784756248.319204:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784756248.319224:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784756248.319305:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784756248.319310:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784756248.319330:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.319349:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02136 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.319358:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.319393:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.319407:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.319422:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c95500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489916928:0@lo:104: 00000100:00100000:3.0:1784756248.319523:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.319571:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756248.319680:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489916928 00000100:00100000:1.0:1784756248.319688:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489916928 00000100:00100000:1.0:1784756248.319734:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784756248.319742:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489916928:12345-0@lo:104: 00010000:00010000:1.0:1784756248.319754:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756248.319816:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756248.319821:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489916928:12345-0@lo:104: Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756248.319836:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784756248.319977:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784756248.319983:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.319990:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609563200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756248.319994:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320003:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756248.320010:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756248.320016:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756248.320049:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320056:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756248.320071:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320079:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609563200/0x1782e2377f02136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0213d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320093:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756248.320095:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756248.320096:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756248.320108:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489917056:0@lo:103: 00000100:00100000:3.0:1784756248.320140:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756248.320182:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917056 00000100:00100000:3.0:1784756248.320186:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917056 00010000:00010000:3.0:1784756248.320201:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 14 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.320222:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784756248.320228:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605f84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:3319:x1871452489917056:12345-0@lo:103: 00010000:00010000:3.0:1784756248.320238:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756248.320243:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 14 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320255:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 14 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320270:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320278:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784756248.320290:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001196849s 00010000:00010000:3.0:1784756248.320294:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320300:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320306:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320322:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320327:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ef800 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:3.0:1784756248.320330:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320337:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320345:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320355:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756248.320382:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605f84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:3319:x1871452489917056:12345-0@lo:103: Request processed in 155us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756248.320388:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784756248.320455:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489917056:0@lo:103: 00010000:00010000:3.0:1784756248.320504:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421eee00/0x1782e2377f0213d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02136 expref: 13 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756248.320514:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c95500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489916928:0@lo:104: 00010000:00010000:3.0:1784756248.320526:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320535:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320542:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756248.320554:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ef800/0x1782e2377f021e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756248.332402:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:6596:x1871452489916672:12345-0@lo:253: Request processed in 60540us (60741us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756248.332417:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784756248.332556:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6596:1871452489916672:0@lo:253: 10000000:01000000:1.0:1784756248.332574:0:6596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784756248.332578:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784756248.332579:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756248.332581:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756248.332582:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756248.332583:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756248.332584:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756248.332586:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756248.332587:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756248.332588:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756248.332590:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756248.332591:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784756248.332605:0:6596:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784756248.338031:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756248.338233:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784756248.338438:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756248.338784:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784756248.339008:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756248.339254:0:6596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784756248.340535:0:6596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1784756248.591281:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784756248.631068:0:6596:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784756248.631075:0:6596:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784756248.631130:0:6596:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784756248.631192:0:6596:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784756248.631208:0:6596:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784756248.631242:0:6596:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1784756249.617551:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756250.638746:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756251.661622:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756252.696623:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756253.325680:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756253.325713:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489917184:0@lo:400: 00000100:00100000:2.0:1784756253.325805:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.325876:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489917312:0@lo:400: 00000100:00100000:2.0:1784756253.325907:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.325940:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756253.325946:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489917440:0@lo:400: 00000100:00100000:2.0:1784756253.325982:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.326018:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917184 00000100:00100000:2.0:1784756253.326028:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917184 00000100:00100000:2.0:1784756253.326097:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756253.326106:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3319:x1871452489917184:12345-0@lo:400: 00000100:00100000:2.0:1784756253.326157:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3319:x1871452489917184:12345-0@lo:400: Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.326165:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756253.326202:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917312 00000100:00100000:2.0:1784756253.326205:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917312 00000100:00100000:2.0:1784756253.326227:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917440 00000100:00100000:2.0:1784756253.326230:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917440 00000100:00100000:2.0:1784756253.326258:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756253.326264:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489917312:12345-0@lo:400: 00000100:00100000:2.0:1784756253.326298:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489917312:12345-0@lo:400: Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.326305:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756253.326316:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756253.326321:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489917440:12345-0@lo:400: 00000100:00100000:2.0:1784756253.326343:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489917440:12345-0@lo:400: Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.326349:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784756253.326390:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608087480 x1871452489917440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756253.326404:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489917440:0@lo:400: 00010000:00080000:2.0:1784756253.326413:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608084a80 x1871452489917312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756253.326430:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489917312:0@lo:400: 00000100:00100000:2.0:1784756253.326456:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489917184:0@lo:400: 00000100:00080000:0.0:1784756253.326965:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756253.709819:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784756253.837575:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784756253.837583:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b761808f800 from 21 10000000:01000000:1.0:1784756253.837588:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784756253.837650:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.837660:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.837672:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756253.837696:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917568:0@lo:101: 00000100:00100000:1.0:1784756253.837766:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756253.837818:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7615074f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756253.837826:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917568 00000100:00100000:0.0:1784756253.837833:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917568 00000100:00100000:0.0:1784756253.837885:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784756253.837894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489917568:12345-0@lo:101: 00010000:00010000:0.0:1784756253.837907:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756253.837930:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f021ec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756253.837965:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f021ec expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756253.837992:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021ec expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756253.838002:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600030200, rc 0) 00000100:00100000:0.0:1784756253.838049:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489917568:12345-0@lo:101: Request processed in 156us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756253.838065:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784756253.838734:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917568:0@lo:101: 00010000:00010000:1.0:1784756253.838758:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.838767:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756253.838821:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917696:0@lo:501: 00000100:00100000:1.0:1784756253.838863:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.838888:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917696 00000100:00100000:1.0:1784756253.838891:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7615074f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.838894:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917696 00000100:00100000:2.0:1784756253.838943:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756253.841299:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489917696:12345-0@lo:501: 00000100:00100000:2.0:1784756253.841672:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489917696:12345-0@lo:501: Request processed in 2719us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.841682:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756253.841776:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917696:0@lo:501: 00000100:00100000:1.0:1784756253.841826:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917824:0@lo:503: 00000100:00100000:1.0:1784756253.842202:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756253.842235:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7604d9f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756253.842328:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917824 00000100:00100000:3.0:1784756253.842334:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917824 00000100:00100000:3.0:1784756253.842370:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784756253.842377:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489917824:12345-0@lo:503: 00000100:00100000:3.0:1784756253.842913:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489917824:12345-0@lo:503: Request processed in 534us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756253.842930:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784756253.845210:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489917824:0@lo:503: 00000100:00100000:1.0:1784756253.845380:0:6903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6903:1871452489917952:0@lo:502: 00000100:00100000:1.0:1784756253.845439:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756253.845491:0:6903:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7615074240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.846225:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489917952 00000100:00100000:2.0:1784756253.846233:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489917952 00000100:00100000:2.0:1784756253.846288:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756253.846297:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6903:x1871452489917952:12345-0@lo:502: 00000100:00100000:2.0:1784756253.846590:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6903:x1871452489917952:12345-0@lo:502: Request processed in 293us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.846597:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784756253.846858:0:6903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6903:1871452489917952:0@lo:502: 00000100:00100000:1.0:1784756253.846926:0:6903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6903:1871452489918080:0@lo:502: 00000100:00100000:1.0:1784756253.846962:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756253.846996:0:6903:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7604d9f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.847042:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918080 00000100:00100000:2.0:1784756253.847047:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918080 00000100:00100000:2.0:1784756253.847202:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784756253.847209:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6903:x1871452489918080:12345-0@lo:502: 00000100:00100000:2.0:1784756253.847345:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:6903:x1871452489918080:12345-0@lo:502: Request processed in 136us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.847352:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756253.847440:0:6903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6903:1871452489918080:0@lo:502: 00000040:00080000:1.0:1784756253.847460:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1784756253.848207:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1784756253.848226:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784756253.848243:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.848254:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756253.848264:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784756253.848266:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b761808f800 from 4 10000000:01000000:2.0:1784756253.848269:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784756253.848296:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.848304:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.848313:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.848327:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918208:0@lo:101: 00000100:00100000:2.0:1784756253.848359:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.848393:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756253.848447:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918208 00000100:00100000:1.0:1784756253.848452:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918208 00000100:00100000:1.0:1784756253.848515:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784756253.848522:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489918208:12345-0@lo:101: 00010000:00010000:1.0:1784756253.848532:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756253.848545:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f021fa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.848565:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f021fa expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.848575:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021fa expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756253.848585:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609563200, rc 0) 00000100:00100000:1.0:1784756253.848617:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489918208:12345-0@lo:101: Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756253.848623:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784756253.848695:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918208:0@lo:101: 00010000:00010000:2.0:1784756253.848708:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.848717:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.848759:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918336:0@lo:256: 00000100:00100000:2.0:1784756253.848787:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.848818:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.848831:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918336 00000100:00100000:2.0:1784756253.848834:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918336 00000100:00100000:2.0:1784756253.848869:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784756253.848876:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489918336:12345-0@lo:256: 20000000:01000000:2.0:1784756253.848888:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784756253.848904:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784756253.848908:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784756253.849192:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489918336:12345-0@lo:256: Request processed in 315us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.849199:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784756253.849230:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918336:0@lo:256: 10000000:01000000:2.0:1784756253.849270:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784756253.849276:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849283:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756253.849291:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784756253.849293:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1784756253.849295:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784756253.849310:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849317:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849325:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.849344:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918464:0@lo:101: 00000100:00100000:2.0:1784756253.849366:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.849379:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.849388:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918464 00000100:00100000:2.0:1784756253.849392:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918464 00000100:00100000:2.0:1784756253.849411:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784756253.849416:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489918464:12345-0@lo:101: 00010000:00010000:2.0:1784756253.849423:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756253.849431:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02208 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849445:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02208 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849453:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02208 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849461:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63400, rc 0) 00000100:00100000:2.0:1784756253.849513:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489918464:12345-0@lo:101: Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.849519:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784756253.849546:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918464:0@lo:101: 00010000:00010000:2.0:1784756253.849556:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.849564:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.849615:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918592:0@lo:501: 00000100:00100000:2.0:1784756253.849638:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.849649:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.849659:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918592 00000100:00100000:2.0:1784756253.849661:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918592 00000100:00100000:2.0:1784756253.849682:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784756253.849688:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489918592:12345-0@lo:501: 00000100:00100000:2.0:1784756253.849898:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489918592:12345-0@lo:501: Request processed in 210us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756253.849906:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784756253.850229:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918592:0@lo:501: 00000100:00100000:2.0:1784756253.850266:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918720:0@lo:503: 00000100:00100000:2.0:1784756253.850304:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.850324:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756253.850683:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918720 00000100:00100000:1.0:1784756253.850689:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918720 00000100:00100000:1.0:1784756253.850718:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784756253.850726:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489918720:12345-0@lo:503: 00000100:00100000:1.0:1784756253.851253:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489918720:12345-0@lo:503: Request processed in 525us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756253.851261:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784756253.851483:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489918720:0@lo:503: 00000100:00100000:3.0:1784756253.851825:0:6904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6904:1871452489918848:0@lo:502: 00000100:00100000:3.0:1784756253.851875:0:6904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756253.851906:0:6904:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763fe736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756253.851961:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918848 00000100:00100000:1.0:1784756253.851966:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918848 00000100:00100000:1.0:1784756253.851996:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784756253.852004:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:6904:x1871452489918848:12345-0@lo:502: 00000100:00100000:1.0:1784756253.852226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:6904:x1871452489918848:12345-0@lo:502: Request processed in 223us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756253.852239:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784756253.852275:0:6904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6904:1871452489918848:0@lo:502: 00000020:01000000:1.0:1784756253.852298:0:6904:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784756253.852306:0:6904:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784756253.852312:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756253.852314:0:6904:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784756253.852319:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784756253.852322:0:6904:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1784756253.852344:0:6904:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784756253.852346:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784756253.852373:0:6904:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b7640c899c0) 00000020:00000080:1.0:1784756253.852394:0:6904:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784756253.852400:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784756253.852461:0:6904:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784756253.852493:0:6904:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784756253.852501:0:6904:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f0221d 00010000:00080000:1.0:1784756253.852530:0:6904:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b7635e57800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784756253.852724:0:6904:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1784756253.909931:0:6904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784756253.909959:0:6904:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784756253.910826:0:6904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756253.911135:0:6904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756253.911185:0:6904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784756253.911243:0:6904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784756253.912195:0:6908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784756253.912201:0:6908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784756253.913328:0:6904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784756253.913339:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784756253.913371:0:6904:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784756253.913400:0:6904:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1782e2377f02224 00000100:00080000:1.0:1784756253.913410:0:6904:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784756253.913416:0:6904:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b7635e57800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1784756253.913452:0:6904:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b7634734e00 x1871452489918976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784756253.913518:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1871452489918976:0@lo:8: 00000100:00100000:3.0:1784756253.913582:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784756253.913729:0:6904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784756253.913781:0:6904:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756253.913785:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756253.913787:0:6904:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784756253.913790:0:6904:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756253.913794:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756253.913796:0:6904:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756253.913798:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756253.913800:0:6904:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784756253.913822:0:6904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6904:1871452489919104:0@lo:502: 00000100:00100000:1.0:1784756253.913874:0:6904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756253.913890:0:6904:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756253.915448:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919104 00000100:00100000:1.0:1784756253.915458:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919104 00000100:00100000:1.0:1784756253.915515:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784756253.915524:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:6904:x1871452489919104:12345-0@lo:502: 00000100:00100000:1.0:1784756253.915809:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:6904:x1871452489919104:12345-0@lo:502: Request processed in 285us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756253.915817:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784756253.916179:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489918976 00000100:00100000:3.0:1784756253.916184:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489918976 00000100:00100000:3.0:1784756253.916206:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756253.916211:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1871452489918976:12345-0@lo:8: 00000100:00100000:2.0:1784756253.916216:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784756253.916223:0:6599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1784756253.916241:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1784756253.916267:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1782e2377f0222b 00002000:00100000:3.0:1784756253.916304:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b763f81a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784756253.916308:0:6598:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1784756253.916311:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1784756253.916351:0:6904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:6904:1871452489919104:0@lo:502: 00000020:01000000:2.0:1784756253.916384:0:6904:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756253.916390:0:6904:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756253.916392:0:6904:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784756253.916397:0:6904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00100000:3.0:1784756253.916420:0:6598:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1784756253.916530:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1784756253.916549:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00002000:00080000:3.0:1784756253.916558:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:2.0:1784756253.916558:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.916578:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784756253.916580:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8b763f819800 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1784756253.916588:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784756253.916591:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b76104c8000 from 1 10000000:01000000:2.0:1784756253.916594:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1784756253.916642:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1871452489918976:12345-0@lo:8: Request processed in 428us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756253.916648:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784756253.916682:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7634734e00 x1871452489918976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784756263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756253.916693:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784756253.916699:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784756253.916707:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784756253.916711:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784756253.916714:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8b7635e57800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784756253.916734:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:2.0:1784756253.916737:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756253.916739:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1871452489918976:0@lo:8: 00010000:00010000:2.0:1784756253.916746:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.916755:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.916772:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489919232:0@lo:101: 00000100:00100000:2.0:1784756253.916806:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.916836:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784756253.917021:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919232 00000100:00100000:3.0:1784756253.917026:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919232 00000100:00100000:3.0:1784756253.917058:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784756253.917066:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489919232:12345-0@lo:101: 00010000:00010000:3.0:1784756253.917074:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756253.917087:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02232 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756253.917116:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756253.917126:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756253.917134:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b76421ef800, rc 0) 00000100:00100000:3.0:1784756253.917162:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489919232:12345-0@lo:101: Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756253.917168:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784756253.917398:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489919232:0@lo:101: 00010000:00010000:2.0:1784756253.917412:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756253.917420:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756253.917463:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489919360:0@lo:501: 00000100:00100000:2.0:1784756253.917516:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756253.917536:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756253.917550:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919360 00000100:00100000:2.0:1784756253.917554:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919360 00000100:00100000:2.0:1784756253.917575:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784756253.917581:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489919360:12345-0@lo:501: 00000100:00100000:2.0:1784756253.917789:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489919360:12345-0@lo:501: Request processed in 207us (271us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784756253.917796:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:1.0:1784756253.917804:0:6908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1784756253.919363:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489919360:0@lo:501: 10000000:01000000:3.0:1784756253.919405:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784756253.919413:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756253.919422:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784756253.919616:0:6908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 161841147204ns, next at 0ns, rc = 0 00000004:00080000:3.0:1784756253.992239:0:6909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784756253.992271:0:6909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919616:0@lo:7: 00000100:00100000:3.0:1784756253.992337:0:6909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756253.992384:0:6909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763fe73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756253.992406:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919616 00000100:00100000:3.0:1784756253.992412:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919616 00000100:00100000:3.0:1784756253.992459:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784756253.992486:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6909:x1871452489919616:12345-0@lo:7: 00000004:00080000:0.0:1784756253.993869:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1784756253.993907:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756253.993936:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489919488:0@lo:13: 00000100:00100000:0.0:1784756253.994165:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784756253.994276:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756253.994299:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919488 00000100:00100000:0.0:1784756253.994306:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919488 00000100:00100000:0.0:1784756253.994343:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756253.994351:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871452489919488:12345-0@lo:13: 00002000:00000024:0.0:1784756253.994378:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1784756253.994417:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871452489919488:12345-0@lo:13: Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756253.994424:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784756253.994462:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c96a00 x1871452489919488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756253.994498:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489919488:0@lo:13: 00002000:00080000:3.0:1784756254.015789:0:6601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784756254.015804:0:6601:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784756254.016269:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6909:x1871452489919616:12345-0@lo:7: Request processed in 23798us (23926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756254.016282:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756254.020255:0:6909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c94e00 x1871452489919616/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784756269 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756254.020277:0:6909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919616:0@lo:7: 00000004:00080000:2.0:1784756254.020295:0:6909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784756254.020343:0:6909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608087480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919744:0@lo:5: 00000100:00100000:2.0:1784756254.020398:0:6909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756254.020510:0:6909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756254.021747:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919744 00000100:00100000:3.0:1784756254.021758:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919744 00000100:00100000:3.0:1784756254.021813:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756254.021821:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6909:x1871452489919744:12345-0@lo:5: 00002000:00080000:3.0:1784756254.021910:0:6599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784756254.021924:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784756254.022408:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6909:x1871452489919744:12345-0@lo:5: Request processed in 587us (2009us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784756254.022416:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784756254.022653:0:6909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608087480 x1871452489919744/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756270 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756254.022670:0:6909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608087480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919744:0@lo:5: 00000004:00080000:1.0:1784756254.022693:0:6909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784756254.022725:0:6909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919872:0@lo:700: 00000100:00100000:1.0:1784756254.022758:0:6909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756254.022794:0:6909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7603c55b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756254.022957:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489919872 00000100:00100000:3.0:1784756254.022962:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489919872 00000100:00100000:3.0:1784756254.023003:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756254.023010:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6909:x1871452489919872:12345-0@lo:700: 00000100:00100000:3.0:1784756254.023038:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6607:1871452489920000:0@lo:700: 00000100:00100000:3.0:1784756254.023081:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756254.023097:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763fe73900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756254.023114:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920000 00000100:00100000:3.0:1784756254.023117:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920000 00000100:00100000:3.0:1784756254.023140:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756254.023146:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6607:x1871452489920000:12345-0@lo:700: 40000000:02000000:3.0:1784756254.091572:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1784756254.098145:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6607:x1871452489920000:12345-0@lo:700: Request processed in 74989us (75054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756254.098160:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784756254.098404:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c94000 x1871452489920000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784756270 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756254.098420:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6607:1871452489920000:0@lo:700: 40000000:02000000:0.0:1784756254.098440:0:6607:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1784756254.157589:0:6625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784756254.157607:0:6625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784756254.157671:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6909:x1871452489919872:12345-0@lo:700: Request processed in 134655us (134907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756254.157689:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784756254.157760:0:6909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7634734a80 x1871452489919872/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784756270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756254.157776:0:6909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489919872:0@lo:700: 00000004:02000040:2.0:1784756254.216958:0:6909:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1784756254.228461:0:6909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489920128:0@lo:5: 00000100:00100000:2.0:1784756254.229266:0:6909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756254.229316:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920128 00000100:00100000:2.0:1784756254.229324:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920128 00000100:00100000:2.0:1784756254.229579:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756254.229598:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6909:x1871452489920128:12345-0@lo:5: 00000100:00100000:0.0:1784756254.235554:0:6909:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b0c0 going to sleep for 11 seconds 00002000:00080000:2.0:1784756254.259260:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1784756254.259283:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1784756254.273861:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6909:x1871452489920128:12345-0@lo:5: Request processed in 44259us (44588us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784756254.273881:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784756254.273920:0:6909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608085f80 x1871452489920128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756254.273935:0:6909:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784756254.273951:0:6909:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b7608085f80 x1871452489920128/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756270 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756254.273963:0:6909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6909:1871452489920128:0@lo:5: 00000004:00080000:2.0:1784756254.273979:0:6909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1784756254.733649:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756254.875867:0:6974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784756255.759174:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756256.781810:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756257.807823:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756258.843850:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756258.959435:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489920256:0@lo:400: 00000100:00100000:1.0:1784756258.959528:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756258.959592:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756258.959599:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489920640:0@lo:400: 00000100:00100000:1.0:1784756258.959629:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756258.959669:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920640 00000100:00100000:1.0:1784756258.959676:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920640 00000100:00100000:1.0:1784756258.959730:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756258.959739:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1871452489920640:12345-0@lo:400: 00000100:00100000:1.0:1784756258.959791:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1871452489920640:12345-0@lo:400: Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756258.959798:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1784756258.959817:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756258.959844:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b76083b1500 x1871452489920640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756258.959859:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489920640:0@lo:400: 00000100:00100000:0.0:1784756258.960119:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920256 00000100:00100000:0.0:1784756258.960124:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920256 00000100:00100000:0.0:1784756258.960168:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784756258.960176:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3320:x1871452489920256:12345-0@lo:400: 00000100:00100000:0.0:1784756258.960212:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3320:x1871452489920256:12345-0@lo:400: Request processed in 37us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756258.960307:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489920256:0@lo:400: 00000100:00100000:0.0:1784756258.960364:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756258.960859:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489920384:0@lo:400: 00000100:00100000:2.0:1784756258.960907:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756258.960942:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756258.960948:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489920512:0@lo:400: 00000100:00100000:2.0:1784756258.960970:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756258.961012:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920384 00000100:00100000:0.0:1784756258.961017:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920384 00000100:00100000:0.0:1784756258.961049:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920512 00000100:00100000:0.0:1784756258.961052:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920512 00000100:00100000:0.0:1784756258.961073:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756258.961079:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489920384:12345-0@lo:400: 00000100:00100000:0.0:1784756258.961116:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489920384:12345-0@lo:400: Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756258.961121:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756258.961133:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784756258.961138:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489920512:12345-0@lo:400: 00000100:00100000:0.0:1784756258.961162:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489920512:12345-0@lo:400: Request processed in 24us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756258.961167:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784756258.961335:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756258.961900:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b76083b3800 x1871452489920512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756258.961914:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489920512:0@lo:400: 00010000:00080000:2.0:1784756258.961932:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b76083b0e00 x1871452489920384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756258.961940:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489920384:0@lo:400: 00000100:00100000:2.0:1784756259.473449:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756259.473497:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489920768:0@lo:13: 00000100:00100000:2.0:1784756259.473572:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756259.473640:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920768 00000100:00100000:2.0:1784756259.473649:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920768 00000100:00100000:2.0:1784756259.473687:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784756259.473695:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1871452489920768:12345-0@lo:13: 00002000:00000024:2.0:1784756259.473725:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756259.473764:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1871452489920768:12345-0@lo:13: Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756259.473771:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756259.473807:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608084000 x1871452489920768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756259.473825:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489920768:0@lo:13: 00000001:00080000:2.0:1784756259.495694:0:6625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784756259.854912:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756260.878072:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756261.901689:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756262.926171:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756263.949834:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756264.085882:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756264.085918:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489920896:0@lo:400: 00000100:00100000:2.0:1784756264.086013:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756264.086087:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489920896 00000100:00100000:2.0:1784756264.086096:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489920896 00000100:00100000:2.0:1784756264.086146:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756264.086155:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3322:x1871452489920896:12345-0@lo:400: 00000100:00100000:2.0:1784756264.086209:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3322:x1871452489920896:12345-0@lo:400: Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756264.086216:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756264.086271:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489920896:0@lo:400: 00000100:00100000:2.0:1784756264.086333:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489921024:0@lo:400: 00000100:00100000:2.0:1784756264.086365:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756264.086401:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921024 00000100:00100000:2.0:1784756264.086405:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921024 00000100:00100000:2.0:1784756264.086435:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784756264.086441:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489921024:12345-0@lo:400: 00000100:00100000:2.0:1784756264.086516:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489921024:12345-0@lo:400: Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756264.086523:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784756264.086832:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608084000 x1871452489921024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756264.086855:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489921024:0@lo:400: 00000100:00100000:2.0:1784756264.086993:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489921152:0@lo:400: 00000100:00100000:2.0:1784756264.087062:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756264.087409:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756264.087419:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489921280:0@lo:400: 00000100:00100000:2.0:1784756264.087457:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756264.087581:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921152 00000100:00100000:2.0:1784756264.087598:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921152 00000100:00100000:2.0:1784756264.087669:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784756264.087682:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489921152:12345-0@lo:400: 00000100:00100000:2.0:1784756264.087756:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489921152:12345-0@lo:400: Request processed in 79us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756264.087764:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784756264.087789:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756264.087816:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c94000 x1871452489921152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756264.087840:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489921152:0@lo:400: 00000100:00100000:0.0:1784756264.092365:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921280 00000100:00100000:0.0:1784756264.092401:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921280 00000100:00100000:0.0:1784756264.092502:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756264.092515:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489921280:12345-0@lo:400: 00000100:00100000:0.0:1784756264.092646:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489921280:12345-0@lo:400: Request processed in 134us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756264.092654:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784756264.096243:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784756264.096332:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c94e00 x1871452489921280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756264.096348:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784756264.096373:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489921280:0@lo:400: 00000100:00100000:3.0:1784756264.595444:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756264.595502:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489921408:0@lo:13: 00000100:00100000:3.0:1784756264.595603:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756264.595720:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921408 00000100:00100000:3.0:1784756264.595731:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921408 00000100:00100000:3.0:1784756264.595793:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756264.595802:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489921408:12345-0@lo:13: 00002000:00000024:3.0:1784756264.595862:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756264.595925:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489921408:12345-0@lo:13: Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756264.595933:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784756264.595993:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7633c96a00 x1871452489921408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756264.596013:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489921408:0@lo:13: 00010000:00010000:3.0:1784756264.973871:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784756264.976554:0:7499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784756264.976561:0:7499:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784756264.976745:0:7499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8b7637cbf000 00000020:01000004:1.0:1784756264.976765:0:7499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784756264.976782:0:7499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784756264.976801:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b7640c8b380) 00000020:00000080:1.0:1784756264.976832:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784756265.005371:0:7499:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1784756265.005977:0:7499:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784756265.045213:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784756265.061358:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784756265.061390:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784756265.062214:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784756265.062240:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784756265.065233:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784756265.065250:0:7499:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784756265.065263:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1782e2377f02247 00000020:01000004:2.0:1784756265.065271:0:7499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784756265.065294:0:7499:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784756265.065298:0:7499:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784756265.065304:0:7499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784756265.065331:0:7499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784756265.065336:0:7499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784756265.102960:0:7499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784756265.103017:0:7499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784756265.103023:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784756265.103025:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784756265.103026:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756265.103032:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756265.103033:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756265.103034:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756265.103036:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784756265.103037:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756265.103039:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756265.103040:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756265.103042:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784756265.103048:0:7499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784756265.103050:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784756265.103051:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784756265.103052:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756265.103053:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756265.103054:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756265.103055:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756265.103056:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784756265.103057:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756265.103057:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756265.103058:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756265.103059:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784756265.103095:0:7499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784756265.103121:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489921536:0@lo:253: 00000100:00100000:3.0:1784756265.103220:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.103341:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756265.103401:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921536 00000100:00100000:0.0:1784756265.103411:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921536 00000100:00100000:0.0:1784756265.104061:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784756265.104075:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:7499:x1871452489921536:12345-0@lo:253: 20000000:01000000:0.0:1784756265.104124:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784756265.104129:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1784756265.104135:0:5787:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1784756265.104139:0:5787:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784756265.108431:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784756265.109024:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1784756265.109045:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784756265.109091:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1784756265.109098:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784756265.109126:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1784756265.109174:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1784756265.109674:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1784756265.109712:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1784756265.109715:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1784756265.109751:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1784756265.109760:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784756265.109809:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1784756265.109829:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1784756265.109861:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1784756265.109871:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784756265.109901:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1784756265.109952:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784756265.113948:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1784756265.113992:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1784756265.114012:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1784756265.114052:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1784756265.114061:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784756265.114092:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1784756265.114099:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1784756265.114130:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1784756265.114141:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784756265.114190:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1784756265.114255:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1784756265.114275:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1784756265.114278:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1784756265.114286:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784756265.114287:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784756265.114290:0:5787:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784756265.114308:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784756265.114311:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784756265.114350:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784756265.114353:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784756265.115830:0:7501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1784756265.115924:0:7501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1784756265.115981:0:7501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1784756265.116370:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1784756265.116415:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1784756265.116964:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1784756265.116982:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784756265.116985:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784756265.120394:0:7502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784756265.121111:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784756265.121164:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784756265.121248:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784756265.121262:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784756265.121265:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784756265.122092:0:7503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1784756265.122156:0:7503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1784756265.122226:0:7503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784756265.122732:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1784756265.122776:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1784756265.122822:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1784756265.122837:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784756265.122839:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784756265.124068:0:7504:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1784756265.124179:0:7504:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1784756265.124214:0:7504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1784756265.128897:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1784756265.128966:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1784756265.129042:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1784756265.129077:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784756265.129106:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129132:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02198 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129141:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021c2 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129148:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021ec expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129154:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02208 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129182:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129190:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129244:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129266:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.129287:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921664:0@lo:104: 00000100:00100000:0.0:1784756265.129386:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756265.129501:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129511:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 16 pid: 5788 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.129520:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921792:0@lo:104: 00010000:00010000:0.0:1784756265.129549:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129559:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 16 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.129568:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921920:0@lo:104: 00010000:00010000:0.0:1784756265.129593:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129609:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 16 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.129618:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489922048:0@lo:104: 00010000:00010000:0.0:1784756265.129645:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.129653:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 16 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.129661:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489922176:0@lo:104: 00000100:00100000:0.0:1784756265.129678:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756265.130395:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784756265.130427:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.130464:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.130510:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.130520:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.130542:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921664 00000100:00100000:1.0:1784756265.130552:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921664 00000100:00100000:1.0:1784756265.130602:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921792 00000100:00100000:1.0:1784756265.130605:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921792 00000100:00100000:1.0:1784756265.130614:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489921920 00000100:00100000:1.0:1784756265.130616:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489921920 00000100:00100000:1.0:1784756265.130623:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922048 00000100:00100000:1.0:1784756265.130626:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922048 00000100:00100000:1.0:1784756265.130634:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922176 00000100:00100000:1.0:1784756265.130636:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922176 00000100:00100000:1.0:1784756265.130650:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756265.130659:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763854c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:5787:x1871452489921664:12345-0@lo:104: 00010000:00010000:1.0:1784756265.130677:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.130762:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756265.130769:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763854c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:5787:x1871452489921664:12345-0@lo:104: Request processed in 111us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.130777:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756265.130834:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756265.130841:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5787:x1871452489921792:12345-0@lo:104: 00010000:00010000:1.0:1784756265.130848:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.130883:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784756265.130888:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:5787:x1871452489921792:12345-0@lo:104: Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.130907:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756265.130921:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756265.130925:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:5787:x1871452489921920:12345-0@lo:104: 00010000:00010000:1.0:1784756265.130933:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.130970:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784756265.130975:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:5787:x1871452489921920:12345-0@lo:104: Request processed in 50us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.130980:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756265.130992:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756265.130998:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:5787:x1871452489922048:12345-0@lo:104: 00010000:00010000:1.0:1784756265.131005:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131030:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784756265.131034:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:5787:x1871452489922048:12345-0@lo:104: Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.131039:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756265.131050:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784756265.131055:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5787:x1871452489922176:12345-0@lo:104: 00010000:00010000:1.0:1784756265.131062:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131084:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784756265.131089:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5787:x1871452489922176:12345-0@lo:104: Request processed in 34us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.131100:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1784756265.131121:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784756265.131128:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131136:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62c00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.131141:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131151:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.131159:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.131164:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.131205:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131212:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.131235:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131243:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f62c00/0x1782e2377f02232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02239 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131260:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784756265.131264:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131281:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63c00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.131284:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131292:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.131299:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.131304:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.131317:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131323:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.131340:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131346:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f63c00/0x1782e2377f02208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0220f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131356:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784756265.131358:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131364:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609563a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.131367:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131387:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.131394:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.131399:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.131413:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131419:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.131425:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131431:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609563a00/0x1782e2377f021ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021f3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131443:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784756265.131447:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131453:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421eea00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.131456:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131463:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.131496:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.131507:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.131521:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131528:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.131534:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131540:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f021c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021c9 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131551:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756265.131554:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131559:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421eec00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.131562:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131569:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.131576:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.131581:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.131593:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131599:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.131611:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131617:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f02198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0219f expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.131632:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.131634:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.131636:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.131644:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.131650:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756265.131674:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922304:0@lo:103: 00000100:00100000:1.0:1784756265.131733:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.131773:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922816:0@lo:103: 00000100:00100000:1.0:1784756265.131795:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.131831:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756265.131837:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922688:0@lo:103: 00000100:00100000:1.0:1784756265.131858:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.131888:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489922432:0@lo:103: 00000100:00100000:1.0:1784756265.131911:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.131921:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756265.131926:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489922560:0@lo:103: 00000100:00100000:1.0:1784756265.131944:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.131971:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922304 00000100:00100000:1.0:1784756265.131977:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922304 00010000:00010000:1.0:1784756265.132002:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 17 pid: 5790 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.132020:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922816 00000100:00100000:1.0:1784756265.132029:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922816 00010000:00010000:1.0:1784756265.132044:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 18 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.132055:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922688 00000100:00100000:1.0:1784756265.132058:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922688 00010000:00010000:1.0:1784756265.132067:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 19 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.132077:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922432 00000100:00100000:1.0:1784756265.132079:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922432 00010000:00010000:1.0:1784756265.132089:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 20 pid: 5788 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.132099:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922560 00000100:00100000:1.0:1784756265.132101:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922560 00010000:00010000:1.0:1784756265.132109:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 21 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.132122:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756265.132128:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3322:x1871452489922304:12345-0@lo:103: 00010000:00010000:1.0:1784756265.132142:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756265.132149:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 21 pid: 5790 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132160:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 21 pid: 5790 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132181:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756265.132211:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3322:x1871452489922304:12345-0@lo:103: Request processed in 83us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.132218:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756265.132242:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756265.132248:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3322:x1871452489922816:12345-0@lo:103: 00010000:00010000:1.0:1784756265.132256:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756265.132261:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 20 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132271:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 20 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132282:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756265.132302:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3322:x1871452489922816:12345-0@lo:103: Request processed in 54us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.132307:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756265.132320:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756265.132325:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489922688:12345-0@lo:103: 00010000:00010000:1.0:1784756265.132332:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756265.132336:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 19 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132344:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 19 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132353:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756265.132372:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489922688:12345-0@lo:103: Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.132378:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756265.132390:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756265.132396:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:3319:x1871452489922432:12345-0@lo:103: 00010000:00010000:1.0:1784756265.132403:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756265.132412:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 18 pid: 5788 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132421:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 18 pid: 5788 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132431:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756265.132457:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:3319:x1871452489922432:12345-0@lo:103: Request processed in 61us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.132463:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756265.132502:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784756265.132508:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:3319:x1871452489922560:12345-0@lo:103: 00010000:00010000:1.0:1784756265.132517:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756265.132522:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 17 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132531:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 17 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132545:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132554:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132570:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132577:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132586:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132599:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132605:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600031e00 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:1.0:1784756265.132610:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132619:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132629:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.132639:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756265.132663:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:3319:x1871452489922560:12345-0@lo:103: Request processed in 155us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.132669:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784756265.132716:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922688:0@lo:103: 00000100:00100000:1.0:1784756265.132725:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922304:0@lo:103: 00000100:00100000:1.0:1784756265.132732:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489922816:0@lo:103: 00000100:00100000:1.0:1784756265.132762:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489922560:0@lo:103: 00000100:00100000:1.0:1784756265.132769:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489922432:0@lo:103: 00010000:00010000:3.0:1784756265.133265:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ef800/0x1782e2377f02239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02232 expref: 16 pid: 5790 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.133282:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921664:0@lo:104: 00010000:00010000:3.0:1784756265.133293:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f63400/0x1782e2377f0220f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02208 expref: 15 pid: 5788 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.133314:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921792:0@lo:104: 00010000:00010000:3.0:1784756265.133325:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600030200/0x1782e2377f021f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f021ec expref: 14 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.133334:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489921920:0@lo:104: 00010000:00010000:3.0:1784756265.133344:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62a00/0x1782e2377f021c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f021c2 expref: 13 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.133353:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489922048:0@lo:104: 00010000:00010000:3.0:1784756265.133362:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ee600/0x1782e2377f0219f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02198 expref: 12 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.133371:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5787:1871452489922176:0@lo:104: 00010000:00010000:3.0:1784756265.133397:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.133408:0:5787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.133415:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.133421:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600031e00/0x1782e2377f0224e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784756265.133439:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784756265.235800:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489921536:0@lo:253: 10000000:01000000:3.0:1784756265.235846:0:7499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784756265.235849:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784756265.235851:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784756265.235852:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756265.235854:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784756265.235855:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756265.235857:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756265.235858:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784756265.235860:0:7499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784756265.235861:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756265.235862:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784756265.235882:0:7499:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b7637cbf000 from lustre-OST0001 10000000:01000000:3.0:1784756265.235905:0:7499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784756265.235908:0:7499:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784756265.235916:0:7499:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b76104c8000 local copy 10000000:01000000:3.0:1784756265.235920:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784756265.235952:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.235964:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.235983:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.236001:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489922944:0@lo:101: 00000100:00100000:3.0:1784756265.236047:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.236091:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756265.240936:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:7499:x1871452489921536:12345-0@lo:253: Request processed in 131444us (132295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.240954:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784756265.241029:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489922944 00000100:00100000:1.0:1784756265.241038:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489922944 00000100:00100000:1.0:1784756265.241091:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784756265.241099:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+11:7499:x1871452489922944:12345-0@lo:101: 00010000:00010000:1.0:1784756265.241116:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756265.241136:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609563a00/0x1782e2377f0225c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02255 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.241162:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563a00/0x1782e2377f0225c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02255 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.241174:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609563a00/0x1782e2377f0225c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02255 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.241185:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609563a00, rc 0) 00000100:00100000:1.0:1784756265.241256:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489922944:12345-0@lo:101: Request processed in 158us (5208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.241262:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784756265.241295:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489922944:0@lo:101: 00010000:00010000:3.0:1784756265.241317:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.241339:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.241500:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923072:0@lo:501: 00000100:00100000:3.0:1784756265.241551:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.241570:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923072 00000100:00100000:0.0:1784756265.241575:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923072 00000100:00100000:3.0:1784756265.241585:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756265.241598:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756265.241605:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923072:12345-0@lo:501: 00000100:00100000:0.0:1784756265.241818:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923072:12345-0@lo:501: Request processed in 205us (258us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784756265.241829:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784756265.241897:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923072:0@lo:501: 10000000:01000000:3.0:1784756265.241909:0:7499:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784756265.241932:0:7499:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784756265.241936:0:7499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.241943:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.241950:0:7499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.241972:0:7499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784756265.241993:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b7637cbf000 10000000:01000000:3.0:1784756265.241997:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784756265.242003:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784756265.242006:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784756265.242010:0:7499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784756265.242012:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784756265.242198:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.242217:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.242227:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.242240:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923200:0@lo:101: 00000100:00100000:3.0:1784756265.242267:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.242289:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96d80 going to sleep for 11 seconds 00010000:00010000:1.0:1784756265.242345:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756265.242352:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.242360:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ee600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.242363:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.242372:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.242380:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.242392:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784756265.242404:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923200 00000100:00100000:0.0:1784756265.242408:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923200 00010000:00010000:1.0:1784756265.242411:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.242417:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.242434:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.242441:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1784756265.242442:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421ee600/0x1782e2377f02255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1782e2377f0225c expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.242448:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923200:12345-0@lo:101: 00010000:00010000:1.0:1784756265.242455:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756265.242455:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756265.242456:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.242458:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756265.242498:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756265.242509:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489923328:0@lo:103: 00010000:00010000:0.0:1784756265.242534:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02263 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.242562:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02263 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.242572:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02263 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.242579:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600030c00, rc 0) 00000100:00100000:0.0:1784756265.242609:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489923200:12345-0@lo:101: Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756265.242615:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784756265.242771:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.242872:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923200:0@lo:101: 00010000:00010000:3.0:1784756265.242884:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.242889:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923328 00010000:00010000:3.0:1784756265.242892:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.242893:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923328 00000100:00100000:0.0:1784756265.242930:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756265.242936:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:3320:x1871452489923328:12345-0@lo:103: 00010000:00010000:0.0:1784756265.242944:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756265.242955:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7609563a00/0x1782e2377f0225c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1782e2377f02255 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756265.242956:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923456:0@lo:501: 00010000:00010000:0.0:1784756265.242965:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756265.242981:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.242989:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:3320:x1871452489923328:12345-0@lo:103: Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.242990:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756265.242995:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756265.243017:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489923328:0@lo:103: 00000100:00100000:1.0:1784756265.243383:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923456 00000100:00100000:1.0:1784756265.243388:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923456 00000100:00100000:1.0:1784756265.243424:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784756265.243431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923456:12345-0@lo:501: 00000100:00100000:1.0:1784756265.243764:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923456:12345-0@lo:501: Request processed in 333us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.243771:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784756265.243792:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923456:0@lo:501: 00000100:00100000:3.0:1784756265.243834:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923584:0@lo:503: 00000100:00100000:3.0:1784756265.243869:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.243896:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756265.244132:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923584 00000100:00100000:1.0:1784756265.244136:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923584 00000100:00100000:1.0:1784756265.244247:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784756265.244255:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923584:12345-0@lo:503: 00000100:00100000:1.0:1784756265.244393:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923584:12345-0@lo:503: Request processed in 139us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.244399:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784756265.244464:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923584:0@lo:503: 00000040:00080000:3.0:1784756265.245358:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784756265.245431:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923712:0@lo:502: 00000100:00100000:3.0:1784756265.245497:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.255784:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.259226:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923712 00000100:00100000:2.0:1784756265.259244:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923712 00000100:00100000:2.0:1784756265.259323:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784756265.259334:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923712:12345-0@lo:502: 00000100:00100000:2.0:1784756265.259613:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923712:12345-0@lo:502: Request processed in 281us (14115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.259628:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756265.259879:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923712:0@lo:502: 00000040:00080000:3.0:1784756265.260223:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784756265.260277:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784756265.260309:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784756265.260354:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784756265.260390:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784756265.260419:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784756265.260453:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923840:0@lo:502: 00000100:00100000:3.0:1784756265.260537:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.260575:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756265.261070:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923840 00000100:00100000:0.0:1784756265.261077:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923840 00000100:00100000:0.0:1784756265.261114:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784756265.261122:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923840:12345-0@lo:502: 00000100:00100000:0.0:1784756265.261302:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923840:12345-0@lo:502: Request processed in 181us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756265.261310:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784756265.261993:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923840:0@lo:502: 00000040:00080000:3.0:1784756265.262285:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784756265.262299:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784756265.262868:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784756265.262876:0:7506:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784756265.262882:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.262885:0:7506:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784756265.262890:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784756265.262904:0:7506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b76083d3380) 00000020:00000080:3.0:1784756265.262926:0:7506:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784756265.262931:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784756265.263003:0:7506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b7637cbf000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784756265.263011:0:7506:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784756265.263016:0:7506:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1782e2377f02278 00010000:00010000:3.0:1784756265.274612:0:7506:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784756265.276318:0:7506:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784756265.284661:0:7506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784756265.285001:0:7506:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784756265.302762:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784756265.303552:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1784756265.309528:0:7506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784756265.309541:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756265.309561:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.309563:0:7506:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784756265.309567:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756265.309571:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.309573:0:7506:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784756265.309576:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784756265.309578:0:7506:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784756265.309652:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756265.309657:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.309658:0:7506:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784756265.309662:0:7506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784756265.309749:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784756265.309772:0:7499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784756265.309796:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.309808:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.309824:0:7499:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b7637cbf000 from 1 10000000:01000000:1.0:1784756265.309827:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756265.309865:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.309872:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.309883:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.309906:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923968:0@lo:101: 00000100:00100000:1.0:1784756265.309990:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.310035:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756265.311965:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489923968 00000100:00100000:3.0:1784756265.311978:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489923968 00000100:00100000:3.0:1784756265.312216:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784756265.312229:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:7499:x1871452489923968:12345-0@lo:101: 00010000:00010000:3.0:1784756265.312245:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756265.312263:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0227f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.312291:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0227f expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.312302:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0227f expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.312312:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b76421eee00, rc 0) 00000100:00100000:3.0:1784756265.312385:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489923968:12345-0@lo:101: Request processed in 160us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.312408:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784756265.312514:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489923968:0@lo:101: 00010000:00010000:1.0:1784756265.312533:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.312554:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.312661:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924096:0@lo:501: 00000100:00100000:1.0:1784756265.312692:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.315895:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.319003:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924096 00000100:00100000:2.0:1784756265.319016:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924096 00000100:00100000:2.0:1784756265.319082:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784756265.319092:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924096:12345-0@lo:501: 00000100:00100000:2.0:1784756265.319434:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924096:12345-0@lo:501: Request processed in 343us (6740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.319444:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784756265.319692:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924096:0@lo:501: 00000100:00100000:0.0:1784756265.319742:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924224:0@lo:503: 00000100:00100000:0.0:1784756265.319787:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.319836:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.321308:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924224 00000100:00100000:2.0:1784756265.321319:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924224 00000100:00100000:2.0:1784756265.321354:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784756265.321362:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924224:12345-0@lo:503: 00000100:00100000:2.0:1784756265.321726:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924224:12345-0@lo:503: Request processed in 363us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.321734:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784756265.321922:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924224:0@lo:503: 00000040:00080000:0.0:1784756265.322210:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756265.322281:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924352:0@lo:502: 00000100:00100000:0.0:1784756265.322324:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.322362:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784756265.324847:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924352 00000100:00100000:3.0:1784756265.325002:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924352 00000100:00100000:3.0:1784756265.325060:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784756265.325070:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924352:12345-0@lo:502: 00000100:00100000:3.0:1784756265.325343:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924352:12345-0@lo:502: Request processed in 273us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.325351:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784756265.325438:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924352:0@lo:502: 00000040:00080000:3.0:1784756265.327028:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784756265.327099:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784756265.327143:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924480:0@lo:502: 00000100:00100000:3.0:1784756265.327206:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756265.327249:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96840 going to sleep for 11 seconds 00000100:00100000:3.0:1784756265.327278:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924480 00000100:00100000:3.0:1784756265.327284:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924480 00000100:00100000:3.0:1784756265.327318:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784756265.327326:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924480:12345-0@lo:502: 00000100:00100000:3.0:1784756265.327510:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924480:12345-0@lo:502: Request processed in 183us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.328310:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784756265.328388:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924480:0@lo:502: 00000040:00080000:3.0:1784756265.328562:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784756265.328574:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784756265.331870:0:7510:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756265.331883:0:7510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.331890:0:7510:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784756265.331899:0:7510:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b7637cbf000 00000020:00000080:3.0:1784756265.331901:0:7510:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784756265.331924:0:7510:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756265.331927:0:7510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756265.331929:0:7510:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784756265.331932:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784756265.332263:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784756265.332288:0:7499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756265.332342:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.332365:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756265.332409:0:7499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784756265.332412:0:7499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b7637cbf000 10000000:01000000:0.0:1784756265.332416:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b7637cbf000 10000000:01000000:0.0:1784756265.332420:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756265.332426:0:7499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7637cbf000 from 1 10000000:01000000:0.0:1784756265.332429:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784756265.332463:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.332525:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.332539:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.332565:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924608:0@lo:101: 00000100:00100000:0.0:1784756265.332643:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.332681:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553540 going to sleep for 11 seconds 00000100:00100000:3.0:1784756265.332907:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924608 00000100:00100000:3.0:1784756265.332915:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924608 00000100:00100000:3.0:1784756265.332963:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784756265.332972:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489924608:12345-0@lo:101: 00010000:00010000:3.0:1784756265.332986:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756265.332998:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0228d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.333019:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0228d expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.333031:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0228d expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756265.333040:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b76421ef600, rc 0) 00000100:00100000:3.0:1784756265.333090:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924608:12345-0@lo:101: Request processed in 118us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.333097:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784756265.333130:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924608:0@lo:101: 00010000:00010000:1.0:1784756265.333145:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.333155:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756265.333250:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924736:0@lo:501: 00000100:00100000:1.0:1784756265.333274:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.333297:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.333307:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924736 00000100:00100000:2.0:1784756265.333311:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924736 00000100:00100000:2.0:1784756265.333378:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784756265.333387:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924736:12345-0@lo:501: 00000100:00100000:2.0:1784756265.333922:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924736:12345-0@lo:501: Request processed in 535us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.333930:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784756265.334003:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924736:0@lo:501: 00000100:00100000:1.0:1784756265.334033:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924864:0@lo:503: 00000100:00100000:1.0:1784756265.334073:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.334246:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756265.334320:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924864 00000100:00100000:3.0:1784756265.334326:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924864 00000100:00100000:3.0:1784756265.334358:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784756265.334367:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924864:12345-0@lo:503: 00000100:00100000:3.0:1784756265.334852:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924864:12345-0@lo:503: Request processed in 484us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756265.334868:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784756265.334963:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924864:0@lo:503: 00000040:00080000:1.0:1784756265.335258:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784756265.335330:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924992:0@lo:502: 00000100:00100000:1.0:1784756265.335796:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.335854:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.335863:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489924992 00000100:00100000:2.0:1784756265.335869:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489924992 00000100:00100000:2.0:1784756265.335909:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784756265.335924:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924992:12345-0@lo:502: 00000100:00100000:2.0:1784756265.336130:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489924992:12345-0@lo:502: Request processed in 207us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.336138:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784756265.336158:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489924992:0@lo:502: 00000040:00080000:1.0:1784756265.336429:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784756265.336754:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784756265.336796:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784756265.336864:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784756265.336904:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784756265.336951:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784756265.336987:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784756265.337022:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784756265.337071:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784756265.337107:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784756265.337141:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784756265.337193:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784756265.337230:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784756265.337260:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784756265.337332:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784756265.337371:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784756265.337407:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784756265.337457:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784756265.337743:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784756265.337785:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784756265.337855:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784756265.337895:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784756265.337932:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784756265.337979:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784756265.338031:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784756265.338067:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784756265.338118:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784756265.338157:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1784756265.338193:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784756265.338239:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1784756265.338286:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1784756265.338323:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1784756265.338359:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1784756265.338409:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1784756265.338445:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1784756265.338791:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1784756265.338845:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1784756265.338892:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489925120:0@lo:502: 00000100:00100000:1.0:1784756265.338965:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.339015:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76051453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.339025:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925120 00000100:00100000:2.0:1784756265.339032:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925120 00000100:00100000:2.0:1784756265.339084:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784756265.339092:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489925120:12345-0@lo:502: 00000100:00100000:2.0:1784756265.339259:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489925120:12345-0@lo:502: Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.339266:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784756265.339293:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489925120:0@lo:502: 00000040:00080000:1.0:1784756265.339355:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784756265.339364:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784756265.340236:0:7511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784756265.340248:0:7511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b76104c99c0) 00000020:00000080:2.0:1784756265.340264:0:7511:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1784756265.340401:0:7511:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b7637cbf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784756265.340406:0:7511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b7637cbf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784756265.340408:0:7511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b7637cbf000 3 00010000:00080000:2.0:1784756265.340433:0:7511:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b763b716800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1784756265.342192:0:7511:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784756265.342289:0:7511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784756265.342321:0:7511:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784756265.342331:0:7511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1782e2377f022a2 00000100:00080000:2.0:1784756265.342340:0:7511:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784756265.342345:0:7511:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b763b716800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1784756265.342379:0:7511:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b7608085f80 x1871452489925248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784756265.342410:0:7511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784756265.342510:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489925376:0@lo:400: 00000100:00100000:2.0:1784756265.342583:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756265.342629:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489925504:0@lo:400: 00000100:00100000:2.0:1784756265.342653:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756265.342670:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756265.342675:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489925632:0@lo:400: 00000100:00100000:2.0:1784756265.342699:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756265.342736:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925376 00000100:00100000:2.0:1784756265.342743:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925376 00000100:00100000:2.0:1784756265.342778:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925504 00000100:00100000:2.0:1784756265.342781:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925504 00000100:00100000:2.0:1784756265.342823:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784756265.342831:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489925376:12345-0@lo:400: 00000100:00100000:2.0:1784756265.342889:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489925376:12345-0@lo:400: Request processed in 58us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.342897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784756265.342912:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756265.342918:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489925504:12345-0@lo:400: 00000100:00100000:2.0:1784756265.342946:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489925504:12345-0@lo:400: Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.342952:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756265.342972:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925632 00000100:00100000:2.0:1784756265.342975:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925632 00000100:00100000:2.0:1784756265.343001:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784756265.343007:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489925632:12345-0@lo:400: 00000100:00100000:2.0:1784756265.343034:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489925632:12345-0@lo:400: Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.343040:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784756265.343081:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608086a00 x1871452489925632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756265.343095:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489925632:0@lo:400: 00010000:00080000:2.0:1784756265.343104:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608086d80 x1871452489925504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756265.343111:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489925504:0@lo:400: 00010000:00080000:2.0:1784756265.343139:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608084380 x1871452489925376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756265.343147:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489925376:0@lo:400: 00000100:00100000:0.0:1784756265.344994:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1871452489925248:0@lo:38: 00000100:00100000:0.0:1784756265.345054:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756265.345092:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925248 00000100:00100000:2.0:1784756265.345098:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925248 00000100:00100000:2.0:1784756265.345141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756265.345148:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1871452489925248:12345-0@lo:38: 00010000:00080000:2.0:1784756265.345172:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1784756265.345207:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1782e2377f022a9 00000004:00100000:2.0:1784756265.345222:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784756265.345252:0:5796:0:(import.c:65:import_set_state_nolock()) ffff8b763b716000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784756265.345308:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1871452489925248:12345-0@lo:38: Request processed in 158us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.345316:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784756265.345340:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7608085f80 x1871452489925248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756265.345349:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784756265.345358:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784756265.345365:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784756265.345370:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784756265.345372:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8b763b716800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784756265.345377:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1871452489925248:0@lo:38: 00000040:00080000:2.0:1784756265.345462:0:7511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1784756265.345627:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1784756265.345654:0:7499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784756265.345674:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.345686:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784756265.345742:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784756265.345745:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784756265.345746:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756265.345747:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756265.345749:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756265.345750:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756265.345751:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756265.345753:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756265.345754:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756265.345755:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756265.345756:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784756265.345759:0:7499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1784756265.345761:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784756265.345763:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784756265.345763:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756265.345764:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756265.345766:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756265.345767:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756265.345768:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756265.345769:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756265.345770:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756265.345771:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756265.345773:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784756265.345789:0:7499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784756265.345802:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489925760:0@lo:253: 00000100:00100000:0.0:1784756265.345850:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.345883:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553300 going to sleep for 11 seconds 00000100:00100000:2.0:1784756265.345884:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925760 00000100:00100000:2.0:1784756265.345888:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925760 00000100:00100000:2.0:1784756265.345925:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784756265.345932:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7499:x1871452489925760:12345-0@lo:253: 20000000:01000000:2.0:1784756265.345959:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784756265.345971:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784756265.346550:0:7513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7513:1871452489925888:0@lo:901: 00000100:00100000:2.0:1784756265.346597:0:7513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756265.346627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489925888 00000100:00100000:2.0:1784756265.346631:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489925888 00000100:00100000:2.0:1784756265.346666:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784756265.346673:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7513:x1871452489925888:12345-0@lo:901: 00000100:00080000:2.0:1784756265.348541:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756265.349274:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7513:x1871452489925888:12345-0@lo:901: Request processed in 2598us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.349287:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784756265.349323:0:7513:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637c96b40 going to sleep for 11 seconds 00010000:00080000:2.0:1784756265.349350:0:7513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b7501151c00 x1871452489925888/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784756281 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756265.349364:0:7513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7513:1871452489925888:0@lo:901: 20000000:01000000:2.0:1784756265.368767:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784756265.368787:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784756265.368963:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784756265.368969:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784756265.368991:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.369010:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021fa expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.369036:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.369075:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756265.369088:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 14 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756265.369103:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489926016:0@lo:104: 00000100:00100000:0.0:1784756265.369165:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756265.369209:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606553540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756265.369346:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926016 00000100:00100000:1.0:1784756265.369355:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926016 00000100:00100000:1.0:1784756265.369412:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756265.369421:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489926016:12345-0@lo:104: 00010000:00010000:1.0:1784756265.369434:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369506:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756265.369513:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:5810:x1871452489926016:12345-0@lo:104: Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756265.369532:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784756265.369553:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756265.369559:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369567:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756265.369577:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369585:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756265.369593:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756265.369599:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756265.369640:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369647:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756265.369664:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369891:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f63200/0x1782e2377f021fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02201 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.369905:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.369907:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756265.369908:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756265.369928:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489926144:0@lo:103: 00000100:00100000:1.0:1784756265.369957:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756265.370018:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1871452489926016:0@lo:104: 00010000:00010000:1.0:1784756265.370036:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756265.370088:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926144 00000100:00100000:2.0:1784756265.370092:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926144 00010000:00010000:2.0:1784756265.370114:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 15 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756265.370143:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756265.370150:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605f86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:3319:x1871452489926144:12345-0@lo:103: 00010000:00010000:2.0:1784756265.370160:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756265.370165:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 15 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370181:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 15 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370193:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7609563200/0x1782e2377f02201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f021fa expref: 15 pid: 5787 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370205:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370213:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784756265.370226:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001258890s 00010000:00010000:2.0:1784756265.370231:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370237:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370244:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370250:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370255:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600031e00 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756265.370259:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370266:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370282:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756265.370291:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756265.370316:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605f86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:3319:x1871452489926144:12345-0@lo:103: Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.370321:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756265.371254:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489926144:0@lo:103: 00010000:00010000:1.0:1784756265.371289:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.371297:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756265.371304:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600031e00/0x1782e2377f022b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756265.380172:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:7499:x1871452489925760:12345-0@lo:253: Request processed in 34230us (34312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756265.380187:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784756265.380194:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7499:1871452489925760:0@lo:253: 10000000:01000000:0.0:1784756265.380209:0:7499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784756265.380212:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784756265.380214:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784756265.380216:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756265.380217:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756265.380218:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756265.380219:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756265.380220:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756265.380221:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756265.380223:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756265.380224:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756265.380226:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784756265.380239:0:7499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784756265.385823:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756265.386238:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756265.386438:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756265.386870:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784756265.387097:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784756265.387333:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784756265.389339:0:7499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784756265.582434:0:7499:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784756265.582441:0:7499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784756265.582572:0:7499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784756265.582636:0:7499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784756265.582652:0:7499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784756265.582679:0:7499:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784756266.000871:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756267.022079:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756268.048365:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756269.071044:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756269.711778:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756269.715759:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489926272:0@lo:13: 00000100:00100000:0.0:1784756269.715862:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756269.719266:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926272 00000100:00100000:2.0:1784756269.719281:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926272 00000100:00100000:2.0:1784756269.719438:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756269.719451:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489926272:12345-0@lo:13: 00002000:00000024:2.0:1784756269.719519:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756269.719747:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489926272:12345-0@lo:13: Request processed in 298us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756269.719753:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784756269.720040:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756269.720085:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501151c00 x1871452489926272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756269.720116:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489926272:0@lo:13: 00010000:00010000:1.0:1784756270.093794:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756270.735603:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489926400:0@lo:400: 00000100:00100000:2.0:1784756270.735678:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756270.735720:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489926912:0@lo:400: 00000100:00100000:2.0:1784756270.735745:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756270.735791:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756270.735798:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489926528:0@lo:400: 00000100:00100000:2.0:1784756270.735822:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756270.735852:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489926656:0@lo:400: 00000100:00100000:2.0:1784756270.735875:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756270.735891:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756270.735897:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489926784:0@lo:400: 00000100:00100000:2.0:1784756270.735921:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756270.735953:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926400 00000100:00100000:2.0:1784756270.735960:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926400 00000100:00100000:2.0:1784756270.736007:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784756270.736016:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:3321:x1871452489926400:12345-0@lo:400: 00000100:00100000:2.0:1784756270.736066:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:3321:x1871452489926400:12345-0@lo:400: Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756270.736074:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784756270.736108:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926912 00000100:00100000:2.0:1784756270.736112:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926912 00000100:00100000:2.0:1784756270.736145:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926528 00000100:00100000:2.0:1784756270.736148:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926528 00000100:00100000:2.0:1784756270.736157:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926656 00000100:00100000:2.0:1784756270.736159:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926656 00000100:00100000:2.0:1784756270.736173:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756270.736178:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489926912:12345-0@lo:400: 00000100:00100000:2.0:1784756270.736209:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489926912:12345-0@lo:400: Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756270.736215:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756270.736226:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784756270.736232:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489926528:12345-0@lo:400: 00000100:00100000:2.0:1784756270.736267:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489926528:12345-0@lo:400: Request processed in 35us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756270.736272:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784756270.736284:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756270.736289:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489926656:12345-0@lo:400: 00000100:00100000:2.0:1784756270.736317:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489926656:12345-0@lo:400: Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756270.736323:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756270.736347:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489926784 00000100:00100000:2.0:1784756270.736351:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489926784 00000100:00100000:2.0:1784756270.736375:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784756270.736381:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489926784:12345-0@lo:400: 00000100:00100000:2.0:1784756270.736409:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489926784:12345-0@lo:400: Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756270.736415:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784756270.736434:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756270.736487:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501153800 x1871452489926784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756270.736502:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489926784:0@lo:400: 00010000:00080000:2.0:1784756270.736514:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501150e00 x1871452489926656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756270.736523:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489926656:0@lo:400: 00010000:00080000:2.0:1784756270.736553:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501152a00 x1871452489926528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756270.736561:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489926528:0@lo:400: 00000100:00100000:2.0:1784756270.736579:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489926400:0@lo:400: 00010000:00080000:2.0:1784756270.736589:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501151500 x1871452489926912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756270.736597:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489926912:0@lo:400: 00010000:00010000:1.0:1784756271.117797:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784756271.843395:0:7854:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784756272.145105:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756273.166679:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756274.189663:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784756274.829628:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784756274.829637:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b760fc26000 from 30 10000000:01000000:1.0:1784756274.829642:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784756274.829692:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.829703:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.829742:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756274.829769:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927040:0@lo:101: 00000100:00100000:1.0:1784756274.829846:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.829903:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.830058:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927040 00000100:00100000:2.0:1784756274.830109:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927040 00000100:00100000:2.0:1784756274.830163:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784756274.830171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489927040:12345-0@lo:101: 00010000:00010000:2.0:1784756274.830185:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756274.830198:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f022b7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.830225:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f022b7 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.830236:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022b7 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.830245:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62a00, rc 0) 00000100:00100000:2.0:1784756274.830291:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927040:12345-0@lo:101: Request processed in 120us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.830298:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784756274.830390:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927040:0@lo:101: 00010000:00010000:1.0:1784756274.830407:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.830416:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756274.830516:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927168:0@lo:501: 00000100:00100000:1.0:1784756274.830543:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.830682:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927168 00000100:00100000:0.0:1784756274.830687:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927168 00000100:00100000:0.0:1784756274.830711:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784756274.830717:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927168:12345-0@lo:501: 00000100:00100000:0.0:1784756274.831142:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927168:12345-0@lo:501: Request processed in 424us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.831149:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784756274.831281:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489927296:0@lo:13: 00000100:00100000:2.0:1784756274.831335:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.831548:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927296 00000100:00100000:0.0:1784756274.831553:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927296 00000100:00100000:1.0:1784756274.831639:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784756274.831657:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927168:0@lo:501: 00000100:00100000:1.0:1784756274.831689:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927424:0@lo:503: 00000100:00100000:1.0:1784756274.831742:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.831803:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.831878:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784756274.831885:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489927296:12345-0@lo:13: 00002000:00000024:0.0:1784756274.831914:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756274.831954:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489927296:12345-0@lo:13: Request processed in 69us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.831960:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1784756274.832039:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756274.832068:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927424 00000100:00100000:2.0:1784756274.832079:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927424 00000100:00100000:2.0:1784756274.832147:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784756274.832154:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927424:12345-0@lo:503: 00000100:00100000:2.0:1784756274.832715:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927424:12345-0@lo:503: Request processed in 561us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.832733:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784756274.832843:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927424:0@lo:503: 00010000:00080000:2.0:1784756274.834034:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c96a00 x1871452489927296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756274.834061:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489927296:0@lo:13: 00000100:00100000:3.0:1784756274.834204:0:7978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7978:1871452489927552:0@lo:502: 00000100:00100000:3.0:1784756274.834273:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.834351:0:7978:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.834389:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927552 00000100:00100000:2.0:1784756274.834394:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927552 00000100:00100000:2.0:1784756274.834496:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784756274.834505:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7978:x1871452489927552:12345-0@lo:502: 00000100:00100000:2.0:1784756274.835024:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7978:x1871452489927552:12345-0@lo:502: Request processed in 519us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.835033:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784756274.835111:0:7978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7978:1871452489927552:0@lo:502: 00000100:00100000:3.0:1784756274.835168:0:7978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7978:1871452489927680:0@lo:502: 00000100:00100000:3.0:1784756274.835202:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.835309:0:7978:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.835364:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927680 00000100:00100000:0.0:1784756274.835371:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927680 00000100:00100000:0.0:1784756274.835401:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784756274.835409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7978:x1871452489927680:12345-0@lo:502: 00000100:00100000:0.0:1784756274.835638:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:7978:x1871452489927680:12345-0@lo:502: Request processed in 230us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.835645:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784756274.835775:0:7978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7978:1871452489927680:0@lo:502: 00000040:00080000:3.0:1784756274.835798:0:7978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784756274.836289:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784756274.836307:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784756274.836318:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.836337:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756274.836349:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784756274.836352:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1784756274.836355:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784756274.836388:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.836397:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.836408:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756274.836424:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927808:0@lo:101: 00000100:00100000:0.0:1784756274.836464:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.836513:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756274.836585:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927808 00000100:00100000:3.0:1784756274.836591:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927808 00000100:00100000:3.0:1784756274.836617:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784756274.836624:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489927808:12345-0@lo:101: 00010000:00010000:3.0:1784756274.836634:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756274.836645:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f022c5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.836670:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f022c5 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.836681:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022c5 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.836701:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b76421ee600, rc 0) 00000100:00100000:3.0:1784756274.836742:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489927808:12345-0@lo:101: Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756274.836750:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784756274.836890:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927808:0@lo:101: 00010000:00010000:0.0:1784756274.836903:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.836911:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756274.836959:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927936:0@lo:501: 00000100:00100000:0.0:1784756274.836982:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.837013:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756274.837057:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489927936 00000100:00100000:3.0:1784756274.837061:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489927936 00000100:00100000:3.0:1784756274.837078:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784756274.837083:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489927936:12345-0@lo:501: 00000100:00100000:3.0:1784756274.837781:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489927936:12345-0@lo:501: Request processed in 695us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756274.837792:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784756274.837884:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489927936:0@lo:501: 00000100:00100000:0.0:1784756274.837918:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928064:0@lo:503: 00000100:00100000:0.0:1784756274.837956:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.837982:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756274.838027:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928064 00000100:00100000:3.0:1784756274.838031:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928064 00000100:00100000:3.0:1784756274.838049:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784756274.838055:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489928064:12345-0@lo:503: 00000100:00100000:3.0:1784756274.838452:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489928064:12345-0@lo:503: Request processed in 396us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756274.838459:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784756274.838734:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928064:0@lo:503: 00000100:00100000:3.0:1784756274.839132:0:7979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7979:1871452489928192:0@lo:502: 00000100:00100000:3.0:1784756274.839174:0:7979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.839241:0:7979:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.839270:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928192 00000100:00100000:2.0:1784756274.839275:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928192 00000100:00100000:2.0:1784756274.839337:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784756274.839345:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:7979:x1871452489928192:12345-0@lo:502: 00000100:00100000:2.0:1784756274.839599:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:7979:x1871452489928192:12345-0@lo:502: Request processed in 255us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.839607:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784756274.839707:0:7979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7979:1871452489928192:0@lo:502: 00000020:01000000:1.0:1784756274.839747:0:7979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756274.839757:0:7979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756274.839765:0:7979:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756274.839772:0:7979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756274.839774:0:7979:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784756274.839792:0:7979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7979:1871452489928320:0@lo:502: 00000100:00100000:1.0:1784756274.839828:0:7979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.840095:0:7979:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756274.840166:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928320 00000100:00100000:3.0:1784756274.840171:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928320 00000100:00100000:3.0:1784756274.840195:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784756274.840201:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:7979:x1871452489928320:12345-0@lo:502: 00000100:00100000:3.0:1784756274.840345:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:7979:x1871452489928320:12345-0@lo:502: Request processed in 143us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756274.840356:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784756274.840429:0:7979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7979:1871452489928320:0@lo:502: 00000020:01000000:1.0:1784756274.840452:0:7979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756274.840457:0:7979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756274.840458:0:7979:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756274.840463:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1784756274.840717:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1784756274.840745:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784756274.840755:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.840766:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756274.840775:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784756274.840777:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b761808f800 from 30 10000000:01000000:3.0:1784756274.840780:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784756274.840804:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.840812:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.840821:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.840834:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928448:0@lo:101: 00000100:00100000:3.0:1784756274.840862:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.840913:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.840983:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928448 00000100:00100000:2.0:1784756274.840987:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928448 00000100:00100000:1.0:1784756274.841025:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784756274.841032:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489928448:12345-0@lo:101: 00010000:00010000:1.0:1784756274.841040:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756274.841051:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f022d3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.841068:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f022d3 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.841076:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022d3 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.841084:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609563e00, rc 0) 00000100:00100000:1.0:1784756274.841118:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489928448:12345-0@lo:101: Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.841123:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784756274.841182:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928448:0@lo:101: 00010000:00010000:3.0:1784756274.841194:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.841203:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.841257:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928576:0@lo:501: 00000100:00100000:3.0:1784756274.841282:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.841302:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.841328:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928576 00000100:00100000:0.0:1784756274.841332:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928576 00000100:00100000:1.0:1784756274.841694:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784756274.841703:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489928576:12345-0@lo:501: 00000100:00100000:1.0:1784756274.841936:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489928576:12345-0@lo:501: Request processed in 234us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.841943:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784756274.842010:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928576:0@lo:501: 00000100:00100000:3.0:1784756274.842040:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928704:0@lo:503: 00000100:00100000:3.0:1784756274.842076:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.842105:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.842154:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928704 00000100:00100000:0.0:1784756274.842159:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928704 00000100:00100000:0.0:1784756274.842179:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784756274.842186:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489928704:12345-0@lo:503: 00000100:00100000:0.0:1784756274.842445:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489928704:12345-0@lo:503: Request processed in 259us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.842452:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784756274.842953:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489928704:0@lo:503: 00000100:00100000:0.0:1784756274.849796:0:7980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7980:1871452489928832:0@lo:502: 00000100:00100000:0.0:1784756274.849897:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.849945:0:7980:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1784756274.850008:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928832 00000100:00100000:1.0:1784756274.850018:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928832 00000100:00100000:1.0:1784756274.850073:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784756274.850083:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:7980:x1871452489928832:12345-0@lo:502: 00000100:00100000:1.0:1784756274.850339:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:7980:x1871452489928832:12345-0@lo:502: Request processed in 257us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.850347:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784756274.850533:0:7980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7980:1871452489928832:0@lo:502: 00000100:00100000:2.0:1784756274.850686:0:7980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501153100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7980:1871452489928960:0@lo:502: 00000100:00100000:2.0:1784756274.850720:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756274.850758:0:7980:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7633cfc600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.851654:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489928960 00000100:00100000:0.0:1784756274.851664:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489928960 00000100:00100000:0.0:1784756274.851714:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784756274.851733:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:7980:x1871452489928960:12345-0@lo:502: 00000100:00100000:0.0:1784756274.851973:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:7980:x1871452489928960:12345-0@lo:502: Request processed in 251us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.851981:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784756274.852627:0:7980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501153100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7980:1871452489928960:0@lo:502: 00000040:00080000:2.0:1784756274.852663:0:7980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784756274.856811:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784756274.856851:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784756274.856864:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.856876:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756274.856887:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784756274.856889:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8b761808f800 from 5 10000000:01000000:3.0:1784756274.856892:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784756274.856934:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.856943:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.856955:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.856991:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929088:0@lo:101: 00000100:00100000:3.0:1784756274.857054:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.857084:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.857152:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929088 00000100:00100000:0.0:1784756274.857159:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929088 00000100:00100000:0.0:1784756274.857216:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784756274.857225:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489929088:12345-0@lo:101: 00010000:00010000:0.0:1784756274.857238:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756274.857253:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7600031e00/0x1782e2377f022e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f022e1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.857274:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7600031e00/0x1782e2377f022e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f022e1 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.857286:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7600031e00/0x1782e2377f022e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022e1 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756274.857296:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7600031e00, rc 0) 00000100:00100000:0.0:1784756274.857348:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489929088:12345-0@lo:101: Request processed in 124us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.857354:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784756274.858084:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929088:0@lo:101: 00010000:00010000:3.0:1784756274.858101:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022e8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.858112:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f022e8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.858168:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929216:0@lo:256: 00000100:00100000:3.0:1784756274.858203:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.858270:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756274.862155:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929216 00000100:00100000:1.0:1784756274.862171:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929216 00000100:00100000:1.0:1784756274.862234:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784756274.862245:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489929216:12345-0@lo:256: 20000000:01000000:1.0:1784756274.862273:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784756274.862298:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784756274.862302:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784756274.862450:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489929216:12345-0@lo:256: Request processed in 207us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.862458:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784756274.862788:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929216:0@lo:256: 10000000:01000000:3.0:1784756274.862856:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784756274.862867:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022e8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.862878:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421eea00/0x1782e2377f022e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022e8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756274.862888:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784756274.862891:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784756274.862894:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784756274.862931:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.862950:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.862961:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.862979:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929344:0@lo:101: 00000100:00100000:3.0:1784756274.863022:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.863067:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.863119:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929344 00000100:00100000:2.0:1784756274.863125:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929344 00000100:00100000:2.0:1784756274.863148:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784756274.863155:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489929344:12345-0@lo:101: 00010000:00010000:2.0:1784756274.863164:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756274.863178:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f022ef expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.863202:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f022ef expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.863212:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022ef expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.863221:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62c00, rc 0) 00000100:00100000:2.0:1784756274.863260:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489929344:12345-0@lo:101: Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.863266:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784756274.863651:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929344:0@lo:101: 00010000:00010000:3.0:1784756274.863665:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756274.863674:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756274.863738:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929472:0@lo:501: 00000100:00100000:3.0:1784756274.863764:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.863795:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.863834:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929472 00000100:00100000:2.0:1784756274.863838:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929472 00000100:00100000:2.0:1784756274.863867:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784756274.863874:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489929472:12345-0@lo:501: 00000100:00100000:2.0:1784756274.864131:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489929472:12345-0@lo:501: Request processed in 256us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.864147:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784756274.864288:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929472:0@lo:501: 00000100:00100000:3.0:1784756274.864318:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929600:0@lo:503: 00000100:00100000:3.0:1784756274.864358:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.864383:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.865849:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929600 00000100:00100000:2.0:1784756274.865862:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929600 00000100:00100000:2.0:1784756274.865924:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784756274.865934:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489929600:12345-0@lo:503: 00000100:00100000:2.0:1784756274.866347:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489929600:12345-0@lo:503: Request processed in 413us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.866355:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784756274.866512:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489929600:0@lo:503: 00000100:00100000:3.0:1784756274.869867:0:7981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7981:1871452489929728:0@lo:502: 00000100:00100000:3.0:1784756274.869963:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756274.870012:0:7981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.870092:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929728 00000100:00100000:0.0:1784756274.870100:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929728 00000100:00100000:0.0:1784756274.870150:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784756274.870159:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:7981:x1871452489929728:12345-0@lo:502: 00000100:00100000:0.0:1784756274.870540:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:7981:x1871452489929728:12345-0@lo:502: Request processed in 380us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756274.870550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784756274.870785:0:7981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7981:1871452489929728:0@lo:502: 00000020:01000000:3.0:1784756274.870825:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784756274.870834:0:7981:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784756274.870840:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756274.870843:0:7981:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784756274.870847:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784756274.870851:0:7981:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:3.0:1784756274.870878:0:7981:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784756274.870881:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784756274.870911:0:7981:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b763474b380) 00000020:00000080:3.0:1784756274.870939:0:7981:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784756274.870946:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784756274.871028:0:7981:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784756274.871034:0:7981:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784756274.871052:0:7981:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1782e2377f02304 00010000:00080000:3.0:1784756274.871085:0:7981:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b7637cf1000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1784756274.871319:0:7981:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1784756274.872155:0:7981:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1784756274.872170:0:7981:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784756274.888848:0:7981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784756274.889100:0:7981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784756274.889155:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784756274.889212:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784756274.890118:0:7982:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784756274.890123:0:7982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784756274.890856:0:7981:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784756274.890870:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784756274.890906:0:7981:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784756274.890930:0:7981:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1782e2377f0230b 00000100:00080000:1.0:1784756274.890944:0:7981:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784756274.890951:0:7981:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b7637cf1000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1784756274.891002:0:7981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b7634735f80 x1871452489929856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784756274.891060:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1871452489929856:0@lo:8: 00000100:00100000:0.0:1784756274.891122:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784756274.891173:0:7981:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784756274.891228:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756274.891232:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756274.891233:0:7981:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784756274.891236:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756274.891240:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756274.891241:0:7981:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756274.891244:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756274.891246:0:7981:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784756274.891266:0:7981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7981:1871452489929984:0@lo:502: 00000100:00100000:1.0:1784756274.891305:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.891320:0:7981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.891450:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929856 00000100:00100000:2.0:1784756274.891458:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929856 00000100:00100000:2.0:1784756274.891500:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756274.891508:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3318:x1871452489929856:12345-0@lo:8: 00010000:00080000:2.0:1784756274.891533:0:6910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1784756274.891555:0:6910:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1782e2377f02312 00002000:00100000:2.0:1784756274.891568:0:6910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b763b710000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784756274.891572:0:6910:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1784756274.891576:0:6910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784756274.891683:0:6910:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784756274.891832:0:6910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784756274.891853:0:6910:0:(import.c:65:import_set_state_nolock()) ffff8b763b714000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756274.892712:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489929984 00000100:00100000:3.0:1784756274.892719:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489929984 00000100:00100000:3.0:1784756274.892768:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784756274.892776:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:7981:x1871452489929984:12345-0@lo:502: 00000100:00100000:3.0:1784756274.893059:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:7981:x1871452489929984:12345-0@lo:502: Request processed in 282us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756274.893066:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784756274.893554:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489930112:0@lo:400: 00000100:00100000:1.0:1784756274.893588:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.893616:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756274.893621:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489930240:0@lo:400: 00000100:00100000:1.0:1784756274.893640:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.893680:0:7981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:7981:1871452489929984:0@lo:502: 00000020:01000000:1.0:1784756274.893711:0:7981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756274.893717:0:7981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756274.893720:0:7981:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756274.893738:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784756274.893796:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784756274.893814:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784756274.893834:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.893855:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756274.893865:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784756274.893867:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b76104c8000 from 1 10000000:01000000:1.0:1784756274.893870:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784756274.893894:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.893903:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756274.893912:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756274.893923:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489930496:0@lo:101: 00000100:00100000:1.0:1784756274.893947:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756274.893967:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.897599:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1871452489929856:12345-0@lo:8: Request processed in 6080us (6464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.897614:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756274.897673:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489930368:0@lo:400: 00000100:00100000:2.0:1784756274.897741:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756274.897800:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930112 00000100:00100000:2.0:1784756274.897808:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930112 00000100:00100000:2.0:1784756274.897838:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930240 00000100:00100000:2.0:1784756274.897841:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930240 00000100:00100000:2.0:1784756274.897862:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930368 00000100:00100000:2.0:1784756274.897864:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930368 00000100:00100000:2.0:1784756274.897876:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756274.897883:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489930112:12345-0@lo:400: 00000100:00100000:2.0:1784756274.897940:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489930112:12345-0@lo:400: Request processed in 57us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.897947:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756274.897959:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756274.897966:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489930240:12345-0@lo:400: 00000100:00100000:2.0:1784756274.897992:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489930240:12345-0@lo:400: Request processed in 27us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.897997:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756274.898007:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784756274.898012:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489930368:12345-0@lo:400: 00000100:00100000:2.0:1784756274.898039:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489930368:12345-0@lo:400: Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.898045:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784756274.898075:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756274.898108:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c95f80 x1871452489930240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756274.898123:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489930240:0@lo:400: 00010000:00080000:2.0:1784756274.898142:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c97100 x1871452489930112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756274.898151:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489930112:0@lo:400: 00010000:00080000:2.0:1784756274.898184:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c95180 x1871452489930368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756274.898193:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489930368:0@lo:400: 00000100:00100000:2.0:1784756274.898208:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930496 00000100:00100000:2.0:1784756274.898211:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930496 00000100:00100000:2.0:1784756274.898234:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784756274.898240:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489930496:12345-0@lo:101: 00010000:00010000:2.0:1784756274.898252:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756274.898273:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02319 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.898299:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02319 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.898311:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02319 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.898320:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63c00, rc 0) 00000100:00100000:2.0:1784756274.898350:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489930496:12345-0@lo:101: Request processed in 110us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756274.898357:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784756274.898394:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489930496:0@lo:101: 00010000:00010000:2.0:1784756274.898411:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.898427:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756274.898535:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489930624:0@lo:501: 00000100:00100000:2.0:1784756274.898561:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756274.898585:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7633cfcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756274.898597:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930624 00000100:00100000:2.0:1784756274.898601:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930624 00000100:00100000:2.0:1784756274.898620:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784756274.898628:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489930624:12345-0@lo:501: 00000100:00100000:2.0:1784756274.898863:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489930624:12345-0@lo:501: Request processed in 237us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784756274.898869:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784756274.898896:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489930624:0@lo:501: 10000000:01000000:2.0:1784756274.898917:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784756274.898923:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756274.898931:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784756274.899407:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7634735f80 x1871452489929856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784756284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756274.899424:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784756274.899441:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784756274.899449:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784756274.899455:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784756274.899458:0:3318:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784756274.899491:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784756274.899498:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1871452489929856:0@lo:8: 00000004:00080000:2.0:1784756274.900019:0:7982:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784756274.900112:0:7982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 182821643969ns, next at 0ns, rc = 0 00000004:00080000:0.0:1784756274.967885:0:7983:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784756274.967915:0:7983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489930880:0@lo:7: 00000100:00100000:0.0:1784756274.967983:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.968031:0:7983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76081910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.968047:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489930752:0@lo:13: 00000100:00100000:0.0:1784756274.968073:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.968113:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930880 00000100:00100000:0.0:1784756274.968121:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930880 00000100:00100000:0.0:1784756274.968177:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756274.968186:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7983:x1871452489930880:12345-0@lo:7: 00000004:00080000:3.0:1784756274.971090:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:1.0:1784756274.971542:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756274.971570:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489930752 00000100:00100000:1.0:1784756274.971581:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489930752 00000100:00100000:1.0:1784756274.971633:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784756274.971644:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871452489930752:12345-0@lo:13: 00002000:00000024:1.0:1784756274.971680:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784756274.971796:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871452489930752:12345-0@lo:13: Request processed in 154us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.971805:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784756274.971975:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b0700 x1871452489930752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756274.971998:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489930752:0@lo:13: 00002000:00080000:1.0:1784756274.987163:0:6601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1784756274.987182:0:6601:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1784756274.987291:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7983:x1871452489930880:12345-0@lo:7: Request processed in 19102us (19304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756274.987302:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784756274.987588:0:7983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b2300 x1871452489930880/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784756290 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756274.987606:0:7983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489930880:0@lo:7: 00000004:00080000:0.0:1784756274.987619:0:7983:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784756274.987673:0:7983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931008:0@lo:5: 00000100:00100000:0.0:1784756274.987713:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.987759:0:7983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76081910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756274.988744:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931008 00000100:00100000:1.0:1784756274.988756:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931008 00000100:00100000:1.0:1784756274.988834:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756274.988844:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7983:x1871452489931008:12345-0@lo:5: 00002000:00080000:1.0:1784756274.988879:0:6599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784756274.988885:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784756274.989242:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7983:x1871452489931008:12345-0@lo:5: Request processed in 399us (1528us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784756274.989250:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784756274.989691:0:7983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b2300 x1871452489931008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756290 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756274.989708:0:7983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931008:0@lo:5: 00000004:00080000:0.0:1784756274.989721:0:7983:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784756274.989769:0:7983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931136:0@lo:700: 00000100:00100000:0.0:1784756274.989804:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.989824:0:7983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76081910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756274.989840:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931136 00000100:00100000:0.0:1784756274.989844:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931136 00000100:00100000:0.0:1784756274.989874:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756274.989881:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7983:x1871452489931136:12345-0@lo:700: 00000100:00100000:0.0:1784756274.989910:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6607:1871452489931264:0@lo:700: 00000100:00100000:0.0:1784756274.989935:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756274.989958:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7608191b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756274.991183:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931264 00000100:00100000:3.0:1784756274.991203:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931264 00000100:00100000:3.0:1784756274.997461:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784756274.997749:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6607:x1871452489931264:12345-0@lo:700: 40000000:02000000:3.0:1784756275.052148:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1784756275.061387:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6607:x1871452489931264:12345-0@lo:700: Request processed in 63643us (71442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756275.061402:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756275.061837:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b0e00 x1871452489931264/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784756290 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756275.061854:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6607:1871452489931264:0@lo:700: 40000000:02000000:2.0:1784756275.061884:0:6607:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1784756275.169673:0:7515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1784756275.169706:0:7515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784756275.169866:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7983:x1871452489931136:12345-0@lo:700: Request processed in 179963us (180039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756275.169889:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784756275.169906:0:7983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b3480 x1871452489931136/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784756290 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756275.169918:0:7983:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784756275.169941:0:7983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931136:0@lo:700: 00000004:02000040:0.0:1784756275.195100:0:7983:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1784756275.202927:0:7983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931392:0@lo:5: 00000100:00100000:2.0:1784756275.209712:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756275.209802:0:7983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76081793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756275.210085:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931392 00000100:00100000:0.0:1784756275.210094:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931392 00000100:00100000:0.0:1784756275.210155:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784756275.210167:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7983:x1871452489931392:12345-0@lo:5: 00002000:00080000:2.0:1784756275.218774:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1784756275.218799:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784756275.222659:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7983:x1871452489931392:12345-0@lo:5: Request processed in 12486us (12944us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784756275.222673:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1784756275.222799:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1784756275.223900:0:7983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76083b3480 x1871452489931392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756291 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756275.223921:0:7983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7983:1871452489931392:0@lo:5: 00000004:00080000:2.0:1784756275.223937:0:7983:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1784756276.238662:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784756276.372143:0:7515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1784756276.879938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.880028:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791104 00000100:00100000:3.0:1784756276.880040:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791104 00000100:00100000:3.0:1784756276.880092:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:3.0:1784756276.880103:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1871452465791104:12345-192.168.202.4@tcp:250: 00010000:00080000:3.0:1784756276.880141:0:5788:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 88574ee4-5a0b-461a-86e7-71d74919f81d@192.168.202.4@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1784756276.880174:0:5788:0:(genops.c:1406:class_connect()) connect: client 88574ee4-5a0b-461a-86e7-71d74919f81d, cookie 0x1782e2377f02327 00000100:00080000:3.0:1784756276.880790:0:5788:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756276.880883:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+5:2352:x1871452465791104:12345-192.168.202.4@tcp:250: Request processed in 774us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.880891:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:2.0:1784756276.885495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.885573:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791232 00000100:00100000:3.0:1784756276.885583:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791232 00000100:00100000:3.0:1784756276.885651:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:3.0:1784756276.885662:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+5:5555:x1871452465791232:12345-192.168.202.4@tcp:101: 00010000:00010000:3.0:1784756276.885680:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756276.885721:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7636d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.885755:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.885767:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.885778:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601678c00, rc 0) 00000100:00100000:3.0:1784756276.885843:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+6:5555:x1871452465791232:12345-192.168.202.4@tcp:101: Request processed in 183us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.885851:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:3.0:1784756276.889821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.889859:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791360 00000100:00100000:3.0:1784756276.889869:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791360 00000100:00100000:3.0:1784756276.889931:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:3.0:1784756276.889942:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+6:5555:x1871452465791360:12345-192.168.202.4@tcp:501: 00000100:00100000:3.0:1784756276.890351:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+6:5555:x1871452465791360:12345-192.168.202.4@tcp:501: Request processed in 409us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784756276.890360:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:1.0:1784756276.892004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.892050:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791488 00000100:00100000:3.0:1784756276.892059:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791488 00000100:00100000:3.0:1784756276.892108:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:3.0:1784756276.892118:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+6:5555:x1871452465791488:12345-192.168.202.4@tcp:101: 00010000:00010000:3.0:1784756276.892136:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756276.892154:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76374 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.892199:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.892212:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756276.892223:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601678600, rc 0) 00000100:00100000:3.0:1784756276.892270:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+7:5555:x1871452465791488:12345-192.168.202.4@tcp:101: Request processed in 153us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.892277:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:3.0:1784756276.894164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756276.894521:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791616 00000100:00100000:1.0:1784756276.894530:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791616 00000100:00100000:1.0:1784756276.895961:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:1.0:1784756276.895975:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+7:5555:x1871452465791616:12345-192.168.202.4@tcp:501: 00000100:00100000:1.0:1784756276.896228:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5555:x1871452465791616:12345-192.168.202.4@tcp:501: Request processed in 254us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756276.896236:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:2.0:1784756276.900234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.900446:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791744 00000100:00100000:3.0:1784756276.900457:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791744 00000100:00100000:3.0:1784756276.900540:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:3.0:1784756276.900550:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5555:x1871452465791744:12345-192.168.202.4@tcp:503: 00000100:00100000:3.0:1784756276.900908:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5555:x1871452465791744:12345-192.168.202.4@tcp:503: Request processed in 358us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.900917:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:1.0:1784756276.914009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756276.914095:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465791872 00000100:00100000:0.0:1784756276.914103:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465791872 00000100:00100000:0.0:1784756276.914227:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1784756276.914236:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5573:x1871452465791872:12345-192.168.202.4@tcp:502: 00000100:00100000:0.0:1784756276.914751:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5573:x1871452465791872:12345-192.168.202.4@tcp:502: Request processed in 513us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756276.914758:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:1.0:1784756276.939916:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.940000:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792000 00000100:00100000:3.0:1784756276.940011:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792000 00000100:00100000:3.0:1784756276.940071:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:3.0:1784756276.940081:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5573:x1871452465792000:12345-192.168.202.4@tcp:502: 00000100:00100000:3.0:1784756276.940363:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5573:x1871452465792000:12345-192.168.202.4@tcp:502: Request processed in 283us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.940371:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:1.0:1784756276.955631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756276.955718:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792128 00000100:00100000:2.0:1784756276.955728:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792128 00000100:00100000:2.0:1784756276.958060:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:2.0:1784756276.958076:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5555:x1871452465792128:12345-192.168.202.4@tcp:101: 00010000:00010000:2.0:1784756276.958095:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756276.958113:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f63a00/0x1782e2377f0233c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7639e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756276.958274:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f63a00/0x1782e2377f0233c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7639e expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756276.958287:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f63a00/0x1782e2377f0233c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7639e expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756276.958307:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63a00, rc 0) 00000100:00100000:2.0:1784756276.958634:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5555:x1871452465792128:12345-192.168.202.4@tcp:101: Request processed in 561us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756276.958642:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:1.0:1784756276.971215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.971395:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792256 00000100:00100000:3.0:1784756276.971407:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792256 00000100:00100000:3.0:1784756276.971498:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:3.0:1784756276.971509:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5555:x1871452465792256:12345-192.168.202.4@tcp:256: 20000000:01000000:3.0:1784756276.971535:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784756276.971555:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784756276.971559:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784756276.971562:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784756276.971565:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784756276.976792:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5555:x1871452465792256:12345-192.168.202.4@tcp:256: Request processed in 5273us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.976808:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1784756276.980063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756276.980149:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792384 00000100:00100000:0.0:1784756276.980158:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792384 00000100:00100000:0.0:1784756276.980208:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:0.0:1784756276.980216:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5555:x1871452465792384:12345-192.168.202.4@tcp:101: 00010000:00010000:0.0:1784756276.980236:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756276.980256:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763a5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756276.980286:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756276.980295:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756276.980302:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6be00, rc 0) 00000100:00100000:0.0:1784756276.980982:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5555:x1871452465792384:12345-192.168.202.4@tcp:101: Request processed in 251us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756276.980993:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:1.0:1784756276.982257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.982310:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792512 00000100:00100000:3.0:1784756276.982317:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792512 00000100:00100000:3.0:1784756276.982363:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:3.0:1784756276.982370:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5555:x1871452465792512:12345-192.168.202.4@tcp:501: 00000100:00100000:3.0:1784756276.982722:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5555:x1871452465792512:12345-192.168.202.4@tcp:501: Request processed in 351us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.982731:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:1.0:1784756276.984538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756276.984634:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792640 00000100:00100000:2.0:1784756276.984643:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792640 00000100:00100000:2.0:1784756276.984697:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:2.0:1784756276.984717:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5555:x1871452465792640:12345-192.168.202.4@tcp:503: 00000100:00100000:2.0:1784756276.985098:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5555:x1871452465792640:12345-192.168.202.4@tcp:503: Request processed in 392us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756276.985106:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1784756276.989295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756276.989502:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792768 00000100:00100000:2.0:1784756276.989514:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792768 00000100:00100000:3.0:1784756276.989635:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:3.0:1784756276.989646:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5578:x1871452465792768:12345-192.168.202.4@tcp:502: 00000100:00100000:3.0:1784756276.989919:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5578:x1871452465792768:12345-192.168.202.4@tcp:502: Request processed in 274us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.989928:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:2.0:1784756276.991514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756276.991634:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465792896 00000100:00100000:3.0:1784756276.991642:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465792896 00000100:00100000:3.0:1784756276.991751:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:3.0:1784756276.991774:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5578:x1871452465792896:12345-192.168.202.4@tcp:502: 00000100:00100000:3.0:1784756276.991950:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5578:x1871452465792896:12345-192.168.202.4@tcp:502: Request processed in 177us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756276.991958:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:0.0:1784756276.996574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756276.996679:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793024 00000100:00100000:2.0:1784756276.996689:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793024 00000100:00100000:2.0:1784756276.996741:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1784756276.996749:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1871452465793024:12345-192.168.202.4@tcp:38: 00010000:00080000:2.0:1784756276.996780:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 8bab229c-803d-40e3-a820-b17a4715ff86@192.168.202.4@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1784756276.996890:0:5794:0:(genops.c:1406:class_connect()) connect: client 8bab229c-803d-40e3-a820-b17a4715ff86, cookie 0x1782e2377f0234a 00000004:00100000:2.0:1784756276.996918:0:5794:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784756276.996924:0:5794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784756277.015299:0:5794:0:(import.c:65:import_set_state_nolock()) ffff8b7637cb9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784756277.015396:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2352:x1871452465793024:12345-192.168.202.4@tcp:38: Request processed in 18643us (18827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756277.015542:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00010000:00010000:1.0:1784756277.261801:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756278.024728:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756278.024794:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756278.024872:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793152 00000100:00100000:1.0:1784756278.024887:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793152 00000100:00100000:1.0:1784756278.024959:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793280 00000100:00100000:1.0:1784756278.024962:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793280 00000100:00100000:1.0:1784756278.024973:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1784756278.024979:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:0:x1871452465793152:12345-192.168.202.4@tcp:41: 00000004:00000024:1.0:1784756278.025014:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784756278.025071:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:0:x1871452465793152:12345-192.168.202.4@tcp:41: Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756278.025076:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1784756278.025089:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:1.0:1784756278.025093:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793280:12345-192.168.202.4@tcp:41: 00000004:00000024:1.0:1784756278.025101:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784756278.025112:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793280:12345-192.168.202.4@tcp:41: Request processed in 19us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756278.025116:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00080000:3.0:1784756278.029789:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756278.031395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756278.031501:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793408 00000100:00100000:2.0:1784756278.031510:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793408 00000100:00100000:2.0:1784756278.031572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1784756278.031582:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793408:12345-192.168.202.4@tcp:40: 00000100:00100000:2.0:1784756278.032019:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793408:12345-192.168.202.4@tcp:40: Request processed in 437us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756278.032024:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:0.0:1784756278.039036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756278.039084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756278.039237:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793536 00000100:00100000:2.0:1784756278.039248:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793536 00000100:00100000:2.0:1784756278.039340:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793664 00000100:00100000:2.0:1784756278.039344:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793664 00000100:00100000:3.0:1784756278.042816:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1784756278.042843:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1871452465793536:12345-192.168.202.4@tcp:8: 00010000:00080000:3.0:1784756278.043140:0:6601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8bab229c-803d-40e3-a820-b17a4715ff86@192.168.202.4@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1784756278.043177:0:6601:0:(genops.c:1406:class_connect()) connect: client 8bab229c-803d-40e3-a820-b17a4715ff86, cookie 0x1782e2377f02351 00002000:00100000:3.0:1784756278.043190:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bab229c-803d-40e3-a820-b17a4715ff86/ffff8b7637cf1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784756278.043214:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784756278.043508:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784756278.043534:0:6601:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756278.043601:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2352:x1871452465793536:12345-192.168.202.4@tcp:8: Request processed in 764us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756278.043608:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1784756278.043639:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784756278.043645:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1871452465793664:12345-192.168.202.4@tcp:8: 00010000:00080000:3.0:1784756278.043661:0:6601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8bab229c-803d-40e3-a820-b17a4715ff86@192.168.202.4@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1784756278.043678:0:6601:0:(genops.c:1406:class_connect()) connect: client 8bab229c-803d-40e3-a820-b17a4715ff86, cookie 0x1782e2377f02358 00002000:00100000:3.0:1784756278.043684:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bab229c-803d-40e3-a820-b17a4715ff86/ffff8b7637cf3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784756278.043707:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784756278.044311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756278.044437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756278.044509:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793792 00000100:00100000:0.0:1784756278.044517:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793792 00000100:00100000:0.0:1784756278.044565:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1784756278.044573:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793792:12345-192.168.202.4@tcp:33: 00002000:00080000:3.0:1784756278.045270:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784756278.045298:0:6601:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756278.045357:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2352:x1871452465793664:12345-192.168.202.4@tcp:8: Request processed in 1709us (6271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756278.045365:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784756278.045484:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465793920 00000100:00100000:3.0:1784756278.045490:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465793920 00000100:00100000:3.0:1784756278.045523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:3.0:1784756278.045531:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465793920:12345-192.168.202.4@tcp:400: 00000100:00100000:3.0:1784756278.045561:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465793920:12345-192.168.202.4@tcp:400: Request processed in 31us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756278.045568:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000004:00080000:3.0:1784756278.077008:0:5797:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32378us 00000004:00200000:0.0:1784756278.109850:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784756278.110053:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:5555:x1871452465793792:12345-192.168.202.4@tcp:33: Request processed in 65475us (65610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756278.110065:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00010000:00010000:0.0:1784756278.285974:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756278.290319:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756278.290430:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794048 00000100:00100000:2.0:1784756278.290440:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794048 00000100:00100000:2.0:1784756278.290591:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784756278.290602:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:5595:x1871452465794048:12345-192.168.202.4@tcp:101: 00010000:00010000:2.0:1784756278.290635:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756278.290714:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f0235f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763cf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.290783:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.290798:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.290813:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756278.291063:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756278.291068:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756278.291145:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.291172:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f0235f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763cf expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.291189:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763cf expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756278.291198:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756278.291201:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756278.291205:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63800, rc 0) 00000100:00100000:2.0:1784756278.291267:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:5595:x1871452465794048:12345-192.168.202.4@tcp:101: Request processed in 667us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756278.291273:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00010000:00010000:1.0:1784756279.312092:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756279.949903:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756279.949930:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489931520:0@lo:13: 00000100:00100000:1.0:1784756279.950000:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756279.950324:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931520 00000100:00100000:3.0:1784756279.950333:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931520 00000100:00100000:3.0:1784756279.950406:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784756279.950417:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489931520:12345-0@lo:13: 00002000:00000024:3.0:1784756279.950451:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756279.950533:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489931520:12345-0@lo:13: Request processed in 118us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756279.950540:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784756279.951121:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756279.951160:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c94700 x1871452489931520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756279.951180:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489931520:0@lo:13: 00000100:00100000:1.0:1784756279.951457:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489931648:0@lo:400: 00000100:00100000:1.0:1784756279.951547:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756279.952021:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931648 00000100:00100000:3.0:1784756279.952027:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931648 00000100:00100000:3.0:1784756279.952204:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784756279.952213:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489931648:12345-0@lo:400: 00000100:00100000:2.0:1784756279.952517:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489932032:0@lo:400: 00000100:00100000:2.0:1784756279.952567:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756279.952626:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489931904:0@lo:400: 00000100:00100000:2.0:1784756279.952651:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756279.952727:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756279.952734:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489931776:0@lo:400: 00000100:00100000:2.0:1784756279.952782:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756279.952841:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932032 00000100:00100000:2.0:1784756279.952846:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932032 00000100:00100000:2.0:1784756279.952881:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931904 00000100:00100000:2.0:1784756279.952894:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931904 00000100:00100000:2.0:1784756279.952928:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489931776 00000100:00100000:2.0:1784756279.952930:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489931776 00000100:00100000:2.0:1784756279.952962:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784756279.952968:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489932032:12345-0@lo:400: 00000100:00100000:2.0:1784756279.953096:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489932032:12345-0@lo:400: Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756279.953104:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784756279.953156:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784756279.953178:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489931904:12345-0@lo:400: 00000100:00100000:2.0:1784756279.953210:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489931904:12345-0@lo:400: Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756279.953216:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784756279.953228:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784756279.953234:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489931776:12345-0@lo:400: 00000100:00100000:2.0:1784756279.953259:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489931776:12345-0@lo:400: Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756279.953263:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1784756279.953280:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756279.953307:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489932032:0@lo:400: 00000100:00100000:2.0:1784756279.953331:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489931776:0@lo:400: 00000100:00100000:2.0:1784756279.953340:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489931904:0@lo:400: 00000100:00100000:3.0:1784756279.954077:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489931648:12345-0@lo:400: Request processed in 1861us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756279.954087:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784756279.955162:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756279.955182:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489932160:0@lo:400: 00000100:00100000:2.0:1784756279.955233:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756279.955375:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932160 00000100:00100000:3.0:1784756279.955399:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932160 00000100:00080000:2.0:1784756279.955847:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756279.955899:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784756279.955914:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489932160:12345-0@lo:400: 00000100:00100000:3.0:1784756279.955969:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489932160:12345-0@lo:400: Request processed in 60us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756279.956041:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489931648:0@lo:400: 00010000:00080000:2.0:1784756279.956193:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641103480 x1871452489932160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756279.956204:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784756279.956231:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489932160:0@lo:400: 00000100:00100000:3.0:1784756279.956385:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784756280.269180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756280.269656:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794176 00000100:00100000:0.0:1784756280.269667:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794176 00000100:00080000:2.0:1784756280.269822:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756280.270174:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1784756280.270187:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:5648:x1871452465794176:12345-192.168.202.4@tcp:41: 00000004:00000024:0.0:1784756280.270237:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784756280.270317:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:5648:x1871452465794176:12345-192.168.202.4@tcp:41: Request processed in 133us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756280.270345:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784756280.275553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756280.275831:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794304 00000100:00100000:2.0:1784756280.275844:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794304 00000100:00100000:2.0:1784756280.275962:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1784756280.275973:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bab229c-803d-40e3-a820-b17a4715ff86+6:5648:x1871452465794304:12345-192.168.202.4@tcp:13: 00002000:00000024:2.0:1784756280.276001:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756280.276078:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bab229c-803d-40e3-a820-b17a4715ff86+6:5648:x1871452465794304:12345-192.168.202.4@tcp:13: Request processed in 107us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756280.276085:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00080000:1.0:1784756280.276275:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756280.283213:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756280.283380:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794432 00000100:00100000:2.0:1784756280.283395:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794432 00000100:00100000:2.0:1784756280.283459:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784756280.283497:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bab229c-803d-40e3-a820-b17a4715ff86+6:5648:x1871452465794432:12345-192.168.202.4@tcp:13: 00000100:00080000:1.0:1784756280.283660:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1784756280.283726:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756280.283790:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bab229c-803d-40e3-a820-b17a4715ff86+6:5648:x1871452465794432:12345-192.168.202.4@tcp:13: Request processed in 322us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756280.283797:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00010000:00010000:1.0:1784756280.342486:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756280.461795:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489932288:0@lo:13: 00000100:00100000:0.0:1784756280.461954:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756280.462080:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932288 00000100:00100000:2.0:1784756280.462089:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932288 00000100:00100000:2.0:1784756280.462142:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784756280.462151:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489932288:12345-0@lo:13: 00002000:00000024:2.0:1784756280.462192:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756280.462239:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489932288:12345-0@lo:13: Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756280.462245:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784756280.463115:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7501151f80 x1871452489932288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756280.463141:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489932288:0@lo:13: 00000001:00100000:1.0:1784756281.031621:0:6625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00010000:00010000:0.0:1784756281.358280:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784756282.052848:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00010000:00010000:0.0:1784756282.386172:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756282.430877:0:8167:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1784756282.566825:0:7515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00010000:00010000:0.0:1784756283.410047:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756283.484584:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756283.484614:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756283.484638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756283.484639:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794944 00000100:00100000:2.0:1784756283.484661:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794944 00000100:00100000:3.0:1784756283.484676:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756283.484694:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794688 00000100:00100000:3.0:1784756283.484697:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794688 00000100:00100000:2.0:1784756283.484712:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794816 00000100:00100000:2.0:1784756283.484715:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794816 00000100:00100000:3.0:1784756283.484726:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1784756283.484734:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:3.0:1784756283.484735:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465794688:12345-192.168.202.4@tcp:400: 00000100:00100000:2.0:1784756283.484740:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465794944:12345-192.168.202.4@tcp:400: 00000100:00100000:3.0:1784756283.484807:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465794688:12345-192.168.202.4@tcp:400: Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756283.484815:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1784756283.484841:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465794560 00000100:00100000:3.0:1784756283.484845:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465794560 00000100:00100000:3.0:1784756283.484870:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:3.0:1784756283.484876:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465794560:12345-192.168.202.4@tcp:400: 00000100:00100000:0.0:1784756283.485824:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:0.0:1784756283.485836:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465794816:12345-192.168.202.4@tcp:400: 00000100:00080000:1.0:1784756283.485925:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784756283.485930:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756283.485932:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756283.488958:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465794944:12345-192.168.202.4@tcp:400: Request processed in 4205us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756283.488974:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:3.0:1784756283.493902:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465794560:12345-192.168.202.4@tcp:400: Request processed in 9011us (9248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756283.493934:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:0.0:1784756283.494560:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465794816:12345-192.168.202.4@tcp:400: Request processed in 8723us (9879us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756283.494571:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00010000:00010000:3.0:1784756284.429597:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756285.069883:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756285.069914:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489932416:0@lo:13: 00000100:00100000:0.0:1784756285.070002:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756285.070225:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932416 00000100:00100000:3.0:1784756285.070233:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932416 00000100:00100000:3.0:1784756285.070309:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784756285.070320:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489932416:12345-0@lo:13: 00002000:00000024:3.0:1784756285.070356:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756285.070408:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489932416:12345-0@lo:13: Request processed in 90us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756285.070416:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1784756285.070462:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c97800 x1871452489932416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756285.070507:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489932416:0@lo:13: 00000100:00080000:1.0:1784756285.070667:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756285.070994:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489932800:0@lo:400: 00000100:00100000:0.0:1784756285.071028:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756285.071058:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756285.071064:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489932928:0@lo:400: 00000100:00100000:0.0:1784756285.071120:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.071284:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489932672:0@lo:400: 00000100:00100000:1.0:1784756285.071315:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.071345:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784756285.071351:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489932544:0@lo:400: 00000100:00100000:1.0:1784756285.071376:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.071399:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489933056:0@lo:400: 00000100:00100000:1.0:1784756285.071426:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.071451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932544 00000100:00100000:1.0:1784756285.071456:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932544 00000100:00100000:1.0:1784756285.071519:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784756285.071526:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489932544:12345-0@lo:400: 00000100:00100000:1.0:1784756285.071565:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489932544:12345-0@lo:400: Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.071571:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784756285.071602:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933056 00000100:00100000:1.0:1784756285.071605:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933056 00000100:00100000:1.0:1784756285.071666:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756285.071672:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489933056:12345-0@lo:400: 00000100:00100000:1.0:1784756285.071703:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489933056:12345-0@lo:400: Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.071710:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784756285.071736:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489932544:0@lo:400: 00010000:00080000:1.0:1784756285.071749:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7633c94a80 x1871452489933056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756285.071759:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489933056:0@lo:400: 00000100:00080000:1.0:1784756285.071787:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756285.072001:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932800 00000100:00100000:3.0:1784756285.072005:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932800 00000100:00100000:3.0:1784756285.072031:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932928 00000100:00100000:3.0:1784756285.072034:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932928 00000100:00100000:3.0:1784756285.072047:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489932672 00000100:00100000:3.0:1784756285.072050:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489932672 00000100:00100000:3.0:1784756285.072064:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756285.072070:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489932800:12345-0@lo:400: 00000100:00100000:3.0:1784756285.072113:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489932800:12345-0@lo:400: Request processed in 43us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756285.072119:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1784756285.072259:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756285.072310:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784756285.072319:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489932928:12345-0@lo:400: 00000100:00100000:1.0:1784756285.072352:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489932928:12345-0@lo:400: Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.072358:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784756285.072376:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756285.072382:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489932672:12345-0@lo:400: 00000100:00100000:1.0:1784756285.072410:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489932672:12345-0@lo:400: Request processed in 29us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.072417:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756285.072444:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489932672:0@lo:400: 00000100:00100000:3.0:1784756285.072572:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489932928:0@lo:400: 00000100:00100000:3.0:1784756285.072582:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489932800:0@lo:400: 00010000:00010000:3.0:1784756285.462863:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756285.581727:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756285.581755:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489933184:0@lo:13: 00000100:00100000:0.0:1784756285.581832:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756285.582779:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933184 00000100:00100000:3.0:1784756285.582790:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933184 00000100:00100000:3.0:1784756285.582831:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784756285.582838:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489933184:12345-0@lo:13: 00002000:00000024:3.0:1784756285.582871:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756285.582957:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489933184:12345-0@lo:13: Request processed in 119us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756285.582962:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1784756285.586778:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102680 x1871452489933184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756285.586809:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489933184:0@lo:13: 00000020:00000080:0.0:1784756285.734218:0:8315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc40302620 20000000:00000080:0.0:1784756285.734235:0:8315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b76344f7c00 uarg=0000000000000000 20000000:01000000:0.0:1784756285.734271:0:8315:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784756285.734274:0:8315:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784756285.734276:0:8315:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784756285.734282:0:8315:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784756285.734287:0:8315:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784756285.734300:0:8315:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784756285.734302:0:8315:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784756285.734799:0:8315:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784756285.734803:0:8315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784756285.735978:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1784756285.736786:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1784756285.736837:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1784756285.736893:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1784756285.736908:0:8315:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784756285.736911:0:8315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784756285.737835:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784756285.738243:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784756285.738302:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784756285.738406:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1784756285.738419:0:8315:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784756285.738421:0:8315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784756285.739237:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784756285.740440:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784756285.740602:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784756285.740651:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784756285.740665:0:8315:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784756285.740667:0:8315:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784756285.741579:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1784756285.742058:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1784756285.742193:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1784756285.742231:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1784756285.742245:0:8315:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784756285.742264:0:8315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742287:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02263 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742295:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0228d expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742301:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022b7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742308:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022c5 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742315:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022d3 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742322:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f022ef expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742329:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02319 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742403:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742410:0:8315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742417:0:8315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742462:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742701:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 9 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.742783:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641101180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933312:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784756285.742928:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742938:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.742946:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933440:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784756285.742975:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.742982:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.742991:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933568:0@lo:104: 00000100:00100000:0.0:1784756285.743025:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756285.743067:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743075:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 18 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743096:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933696:0@lo:104: 00000100:00100000:0.0:1784756285.743129:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756285.743159:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743167:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743175:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933824:0@lo:104: 00010000:00010000:0.0:1784756285.743198:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743204:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743212:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933952:0@lo:104: 00010000:00010000:0.0:1784756285.743232:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743239:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743247:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934080:0@lo:104: 00010000:00010000:0.0:1784756285.743266:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743274:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743294:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934208:0@lo:104: 00010000:00010000:0.0:1784756285.743320:0:8315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.743328:0:8315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 18 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.743406:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934336:0@lo:104: 00000100:00100000:0.0:1784756285.743426:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7604d9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756285.743561:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784756285.743579:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.743592:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.743600:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.743607:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.743616:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.743631:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933568 00000100:00100000:1.0:1784756285.743638:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933568 00000100:00100000:1.0:1784756285.743674:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933696 00000100:00100000:1.0:1784756285.743677:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933696 00000100:00100000:1.0:1784756285.743686:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933824 00000100:00100000:1.0:1784756285.743688:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933824 00000100:00100000:1.0:1784756285.743697:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489933952 00000100:00100000:1.0:1784756285.743699:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489933952 00000100:00100000:1.0:1784756285.743720:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934080 00000100:00100000:1.0:1784756285.743723:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934080 00000100:00100000:1.0:1784756285.743730:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934208 00000100:00100000:1.0:1784756285.743732:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934208 00000100:00100000:1.0:1784756285.743739:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934336 00000100:00100000:1.0:1784756285.743741:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934336 00000100:00100000:1.0:1784756285.743752:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756285.743760:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:8315:x1871452489933568:12345-0@lo:104: 00010000:00010000:1.0:1784756285.743773:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.743827:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756285.743834:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+9:8315:x1871452489933568:12345-0@lo:104: Request processed in 75us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.743841:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756285.743858:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784756285.743865:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+8:8315:x1871452489933696:12345-0@lo:104: 00010000:00010000:1.0:1784756285.743878:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.743914:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784756285.743919:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+8:8315:x1871452489933696:12345-0@lo:104: Request processed in 55us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.743925:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784756285.743953:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756285.743959:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:8315:x1871452489933824:12345-0@lo:104: 00010000:00010000:1.0:1784756285.743966:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.743996:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784756285.744001:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+7:8315:x1871452489933824:12345-0@lo:104: Request processed in 43us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.744007:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756285.744020:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756285.744025:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:8315:x1871452489933952:12345-0@lo:104: 00010000:00010000:1.0:1784756285.744031:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744054:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784756285.744058:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+6:8315:x1871452489933952:12345-0@lo:104: Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.744064:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756285.744076:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756285.744082:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:8315:x1871452489934080:12345-0@lo:104: 00010000:00010000:1.0:1784756285.744094:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744130:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784756285.744135:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:8315:x1871452489934080:12345-0@lo:104: Request processed in 55us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.744140:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756285.744152:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756285.744157:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:8315:x1871452489934208:12345-0@lo:104: 00010000:00010000:1.0:1784756285.744164:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744187:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1784756285.744192:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:8315:x1871452489934208:12345-0@lo:104: Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.744198:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756285.744209:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784756285.744214:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:8315:x1871452489934336:12345-0@lo:104: 00010000:00010000:1.0:1784756285.744221:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744244:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1784756285.744248:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:8315:x1871452489934336:12345-0@lo:104: Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.744253:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1784756285.744269:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1784756285.744274:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744286:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609562200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744290:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744298:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744305:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744310:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744347:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744354:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744373:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744380:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f02319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02320 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744394:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784756285.744397:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744403:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ef000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744406:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744423:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744429:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744434:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744447:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744452:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744458:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744464:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421ef000/0x1782e2377f022ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744503:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784756285.744506:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744511:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421eec00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744514:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744520:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744526:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744537:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744550:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744555:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744570:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744576:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421eec00/0x1782e2377f022d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022da expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744586:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784756285.744589:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744594:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600030200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744597:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744604:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744610:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744615:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744638:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744644:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744658:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744664:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7600030200/0x1782e2377f022c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744674:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784756285.744677:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744682:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609562800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744685:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744691:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744697:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744702:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744714:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744720:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744723:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744729:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f022b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f022be expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744737:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784756285.744745:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744750:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600031c00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744753:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744759:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744766:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744771:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744797:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744803:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744807:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744813:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7600031c00/0x1782e2377f0228d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02294 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744823:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756285.744826:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744832:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ef800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1784756285.744835:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744852:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756285.744857:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756285.744862:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756285.744873:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744878:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756285.744882:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744888:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b76421ef800/0x1782e2377f02263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f0226a expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.744900:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756285.744902:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756285.744903:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756285.744910:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756285.744915:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756285.744926:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934464:0@lo:103: 00000100:00100000:1.0:1784756285.744957:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.744987:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934976:0@lo:103: 00000100:00100000:1.0:1784756285.745005:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745022:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784756285.745026:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934592:0@lo:103: 00000100:00100000:1.0:1784756285.745051:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745063:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489935104:0@lo:103: 00000100:00100000:1.0:1784756285.745078:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745096:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489934720:0@lo:103: 00000100:00100000:1.0:1784756285.745113:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745120:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489935232:0@lo:103: 00000100:00100000:1.0:1784756285.745133:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745142:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756285.745146:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489934848:0@lo:103: 00000100:00100000:1.0:1784756285.745164:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756285.745185:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934464 00000100:00100000:1.0:1784756285.745190:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934464 00010000:00010000:1.0:1784756285.745209:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 19 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745225:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934976 00000100:00100000:1.0:1784756285.745227:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934976 00010000:00010000:1.0:1784756285.745236:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 20 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745246:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934592 00000100:00100000:1.0:1784756285.745249:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934592 00010000:00010000:1.0:1784756285.745256:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 21 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745263:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935104 00000100:00100000:1.0:1784756285.745265:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935104 00010000:00010000:1.0:1784756285.745271:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 22 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745290:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934720 00000100:00100000:1.0:1784756285.745292:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934720 00010000:00010000:1.0:1784756285.745301:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 23 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745309:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935232 00000100:00100000:1.0:1784756285.745311:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935232 00010000:00010000:1.0:1784756285.745318:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 24 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745325:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489934848 00000100:00100000:1.0:1784756285.745327:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489934848 00010000:00010000:1.0:1784756285.745333:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 25 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.745342:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756285.745346:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+25:3321:x1871452489934464:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745355:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745360:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 25 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745368:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 25 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745381:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745405:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+25:3321:x1871452489934464:12345-0@lo:103: Request processed in 58us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745411:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756285.745422:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784756285.745433:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+24:3321:x1871452489934976:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745440:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745445:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 24 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745452:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 24 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745461:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745501:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+24:3321:x1871452489934976:12345-0@lo:103: Request processed in 68us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745507:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784756285.745519:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756285.745525:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+23:3321:x1871452489934592:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745532:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745536:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 23 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745543:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 23 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745552:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745571:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+23:3321:x1871452489934592:12345-0@lo:103: Request processed in 46us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745577:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756285.745587:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756285.745593:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+22:3321:x1871452489935104:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745601:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745610:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 22 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745618:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 22 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745641:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745663:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+22:3321:x1871452489935104:12345-0@lo:103: Request processed in 70us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745669:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756285.745681:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756285.745686:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3319:x1871452489934720:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745693:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745697:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 21 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745705:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 21 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745713:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745737:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3319:x1871452489934720:12345-0@lo:103: Request processed in 51us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745743:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756285.745754:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756285.745759:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3319:x1871452489935232:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745766:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745770:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 20 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745786:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 20 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745796:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745816:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3319:x1871452489935232:12345-0@lo:103: Request processed in 57us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745821:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756285.745834:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784756285.745839:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489934848:12345-0@lo:103: 00010000:00010000:1.0:1784756285.745846:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756285.745851:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 19 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745858:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 19 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756285.745866:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756285.745885:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489934848:12345-0@lo:103: Request processed in 46us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756285.745889:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784756285.745942:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489934848:0@lo:103: 00000100:00100000:1.0:1784756285.745950:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489934720:0@lo:103: 00000100:00100000:1.0:1784756285.745957:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489935232:0@lo:103: 00000100:00100000:1.0:1784756285.745981:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934592:0@lo:103: 00000100:00100000:1.0:1784756285.745988:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489935104:0@lo:103: 00000100:00100000:1.0:1784756285.746003:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934464:0@lo:103: 00000100:00100000:1.0:1784756285.746010:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489934976:0@lo:103: 00010000:00010000:0.0:1784756285.746319:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f63c00/0x1782e2377f02320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02319 expref: 18 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746344:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933568:0@lo:104: 00010000:00010000:0.0:1784756285.746355:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62c00/0x1782e2377f022f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f022ef expref: 17 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746362:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933696:0@lo:104: 00010000:00010000:0.0:1784756285.746371:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7609563e00/0x1782e2377f022da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f022d3 expref: 16 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746380:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933824:0@lo:104: 00010000:00010000:0.0:1784756285.746390:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ee600/0x1782e2377f022cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f022c5 expref: 15 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746397:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933952:0@lo:104: 00010000:00010000:0.0:1784756285.746406:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62a00/0x1782e2377f022be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f022b7 expref: 14 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746426:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934080:0@lo:104: 00010000:00010000:0.0:1784756285.746439:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421ef600/0x1782e2377f02294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f0228d expref: 13 pid: 5790 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746446:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934208:0@lo:104: 00010000:00010000:0.0:1784756285.746455:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600030c00/0x1782e2377f0226a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02263 expref: 12 pid: 5788 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.746463:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489934336:0@lo:104: 00000100:00100000:0.0:1784756285.750032:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641101180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933312:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784756285.750044:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8315:1871452489933440:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784756285.750088:0:8315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756285.753655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756285.753733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756285.754442:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795072 00000100:00100000:1.0:1784756285.754552:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795072 00010000:00010000:1.0:1784756285.754593:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 10 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756285.754783:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795200 00000100:00100000:1.0:1784756285.754788:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795200 00010000:00010000:1.0:1784756285.754802:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 11 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756285.754876:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1784756285.754889:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88574ee4-5a0b-461a-86e7-71d74919f81d+11:2355:x1871452465795072:12345-192.168.202.4@tcp:103: 00010000:00010000:0.0:1784756285.754908:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756285.754914:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 11 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.754927:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 11 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.754948:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7601678600/0x1782e2377f02335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76374 expref: 11 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.754986:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756285.755049:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465795072:12345-192.168.202.4@tcp:103: Request processed in 163us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756285.755057:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1784756285.755075:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1784756285.755081:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88574ee4-5a0b-461a-86e7-71d74919f81d+9:2355:x1871452465795200:12345-192.168.202.4@tcp:103: 00010000:00010000:0.0:1784756285.755088:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756285.755092:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755101:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755111:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7601678c00/0x1782e2377f0232e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7636d expref: 9 pid: 5790 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755134:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755143:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755160:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755167:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755173:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755187:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755193:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6a600 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:0.0:1784756285.755197:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755205:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755221:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.755232:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756285.755251:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:2355:x1871452465795200:12345-192.168.202.4@tcp:103: Request processed in 169us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756285.755258:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00010000:00010000:0.0:1784756285.760999:0:8315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.761018:0:8315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756285.761025:0:8315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0236d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756286.477978:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756287.502029:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784756287.694906:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784756287.694913:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7637cbf000 from 39 10000000:01000000:3.0:1784756287.694919:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784756287.694966:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.694978:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.694989:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756287.695014:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935360:0@lo:101: 00000100:00100000:3.0:1784756287.695090:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756287.695168:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9aea80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.696090:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935360 00000100:00100000:0.0:1784756287.696099:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935360 00000100:00100000:0.0:1784756287.696158:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784756287.696167:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+12:5792:x1871452489935360:12345-0@lo:101: 00010000:00010000:0.0:1784756287.696191:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756287.696207:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0237b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02374 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.696231:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0237b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02374 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.696242:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6a600/0x1782e2377f0237b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02374 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.696251:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a600, rc 0) 00000100:00100000:0.0:1784756287.696310:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489935360:12345-0@lo:101: Request processed in 144us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.696317:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784756287.696506:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935360:0@lo:101: 00010000:00010000:2.0:1784756287.696524:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0237b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.696533:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0237b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756287.696593:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935488:0@lo:501: 00000100:00100000:2.0:1784756287.696636:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.696991:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763f996180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.699329:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935488 00000100:00100000:3.0:1784756287.699342:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935488 00000100:00100000:3.0:1784756287.699396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784756287.699405:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489935488:12345-0@lo:501: 00000100:00100000:3.0:1784756287.699751:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489935488:12345-0@lo:501: Request processed in 347us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.699759:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784756287.699937:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935488:0@lo:501: 00000100:00100000:1.0:1784756287.699984:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935616:0@lo:503: 00000100:00100000:1.0:1784756287.700025:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.700056:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520840 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.700115:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935616 00000100:00100000:0.0:1784756287.700120:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935616 00000100:00100000:0.0:1784756287.700154:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784756287.700161:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489935616:12345-0@lo:503: 00000100:00100000:0.0:1784756287.700317:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489935616:12345-0@lo:503: Request processed in 156us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.700324:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784756287.700453:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489935616:0@lo:503: 00000100:00100000:1.0:1784756287.701021:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8331:1871452489935744:0@lo:502: 00000100:00100000:1.0:1784756287.701057:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.701084:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520180 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.701129:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935744 00000100:00100000:0.0:1784756287.701133:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935744 00000100:00100000:0.0:1784756287.701166:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784756287.701173:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:8331:x1871452489935744:12345-0@lo:502: 00000100:00100000:0.0:1784756287.701350:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:8331:x1871452489935744:12345-0@lo:502: Request processed in 177us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.701366:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784756287.701508:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8331:1871452489935744:0@lo:502: 00000100:00100000:2.0:1784756287.701549:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8331:1871452489935872:0@lo:502: 00000100:00100000:2.0:1784756287.701594:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.701628:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763f996180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.701742:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489935872 00000100:00100000:3.0:1784756287.701747:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489935872 00000100:00100000:3.0:1784756287.701770:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784756287.701777:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:8331:x1871452489935872:12345-0@lo:502: 00000100:00100000:3.0:1784756287.701923:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:8331:x1871452489935872:12345-0@lo:502: Request processed in 145us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.701929:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784756287.702010:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8331:1871452489935872:0@lo:502: 00000040:00080000:2.0:1784756287.702031:0:8331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784756287.702181:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784756287.702199:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784756287.702209:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0237b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.702220:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7601679c00/0x1782e2377f02374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0237b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756287.702237:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784756287.702239:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784756287.702242:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784756287.702267:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.702275:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.702283:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.702295:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936000:0@lo:101: 00000100:00100000:1.0:1784756287.702323:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.702343:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76065203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.702394:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936000 00000100:00100000:3.0:1784756287.702399:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936000 00000100:00100000:3.0:1784756287.702428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784756287.702435:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+13:5792:x1871452489936000:12345-0@lo:101: 00010000:00010000:3.0:1784756287.702444:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756287.702456:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7601678e00/0x1782e2377f02389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02382 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.702521:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7601678e00/0x1782e2377f02389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02382 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.702533:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7601678e00/0x1782e2377f02389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02382 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.702551:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601678e00, rc 0) 00000100:00100000:3.0:1784756287.702579:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936000:12345-0@lo:101: Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.702585:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784756287.702760:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936000:0@lo:101: 00010000:00010000:2.0:1784756287.702774:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02389 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.702783:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02389 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756287.702822:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936128:0@lo:501: 00000100:00100000:2.0:1784756287.702846:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.702872:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76122ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.702959:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936128 00000100:00100000:0.0:1784756287.702963:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936128 00000100:00100000:0.0:1784756287.702989:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784756287.702995:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936128:12345-0@lo:501: 00000100:00100000:0.0:1784756287.703196:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936128:12345-0@lo:501: Request processed in 200us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.703202:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784756287.703300:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936128:0@lo:501: 00000100:00100000:2.0:1784756287.703326:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936256:0@lo:503: 00000100:00100000:2.0:1784756287.703361:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.703380:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76122ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.703425:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936256 00000100:00100000:3.0:1784756287.703429:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936256 00000100:00100000:3.0:1784756287.703458:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784756287.703464:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936256:12345-0@lo:503: 00000100:00100000:3.0:1784756287.703739:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936256:12345-0@lo:503: Request processed in 274us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.703746:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784756287.703856:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936256:0@lo:503: 00000100:00100000:3.0:1784756287.704214:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8332:1871452489936384:0@lo:502: 00000100:00100000:3.0:1784756287.704252:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756287.704321:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543b600 going to sleep for 11 seconds 00000100:00100000:1.0:1784756287.704425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936384 00000100:00100000:1.0:1784756287.704430:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936384 00000100:00100000:1.0:1784756287.704586:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784756287.704595:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:8332:x1871452489936384:12345-0@lo:502: 00000100:00100000:1.0:1784756287.704776:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:8332:x1871452489936384:12345-0@lo:502: Request processed in 182us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756287.704784:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784756287.705239:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8332:1871452489936384:0@lo:502: 00000020:01000000:0.0:1784756287.705267:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756287.705276:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756287.705278:0:8332:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784756287.705284:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784756287.705311:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8332:1871452489936512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.705348:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.705724:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76117140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.705771:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936512 00000100:00100000:3.0:1784756287.705776:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936512 00000100:00100000:2.0:1784756287.705819:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784756287.705828:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:8332:x1871452489936512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.706005:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:8332:x1871452489936512:12345-0@lo:502:llog_process_th.0 Request processed in 178us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756287.706012:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784756287.706127:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8332:1871452489936512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784756287.706148:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756287.706153:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756287.706155:0:8332:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784756287.706158:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784756287.706309:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784756287.706332:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784756287.706342:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02389 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.706352:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562800/0x1782e2377f02382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02389 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756287.706361:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784756287.706363:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b760fc26000 from 39 10000000:01000000:2.0:1784756287.706366:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756287.706392:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.706400:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.706409:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756287.706424:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.706455:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.706519:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76122ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.706636:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936640 00000100:00100000:0.0:1784756287.706641:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936640 00000100:00100000:0.0:1784756287.706662:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784756287.706667:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+14:5792:x1871452489936640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756287.706676:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756287.706692:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6b800/0x1782e2377f02397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02390 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.706713:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6b800/0x1782e2377f02397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02390 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.706722:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6b800/0x1782e2377f02397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02390 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.706731:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6b800, rc 0) 00000100:00100000:0.0:1784756287.706764:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489936640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.706770:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784756287.706800:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756287.706811:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02397 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.706819:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02397 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756287.706874:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.706900:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.706912:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76117140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.706922:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936768 00000100:00100000:0.0:1784756287.706924:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936768 00000100:00100000:0.0:1784756287.706940:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784756287.706945:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489936768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.707146:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489936768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.707157:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784756287.707187:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.707212:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.707245:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.707259:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76117140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.707269:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489936896 00000100:00100000:0.0:1784756287.707273:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489936896 00000100:00100000:0.0:1784756287.707289:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784756287.707295:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489936896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.707420:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489936896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.707427:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784756287.707462:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489936896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.708181:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8333:1871452489937024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.708221:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.708253:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761e792d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756287.708298:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937024 00000100:00100000:1.0:1784756287.708302:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937024 00000100:00100000:1.0:1784756287.708336:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784756287.708343:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:8333:x1871452489937024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756287.708824:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:8333:x1871452489937024:12345-0@lo:502:llog_process_th.0 Request processed in 481us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756287.708848:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784756287.708952:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8333:1871452489937024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.709000:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8333:1871452489937152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.709035:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.709064:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761e792d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756287.709211:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937152 00000100:00100000:1.0:1784756287.709217:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937152 00000100:00100000:1.0:1784756287.709253:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784756287.709260:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:8333:x1871452489937152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756287.709406:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:8333:x1871452489937152:12345-0@lo:502:llog_process_th.0 Request processed in 145us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756287.709412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784756287.709520:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8333:1871452489937152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784756287.709539:0:8333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784756287.709759:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784756287.709775:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784756287.709785:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02397 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.709795:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f62400/0x1782e2377f02390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02397 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756287.709804:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784756287.709807:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1784756287.709809:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784756287.709842:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.709850:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.709859:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.709875:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.709909:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.709931:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520840 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.710015:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937280 00000100:00100000:0.0:1784756287.710026:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937280 00000100:00100000:0.0:1784756287.710059:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784756287.710066:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+15:5792:x1871452489937280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756287.710073:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756287.710086:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6b600/0x1782e2377f023a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0239e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.710104:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6b600/0x1782e2377f023a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0239e expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.710115:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6b600/0x1782e2377f023a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0239e expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.710124:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6b600, rc 0) 00000100:00100000:0.0:1784756287.710150:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.710156:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784756287.710313:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756287.710326:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023a5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.710336:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f023a5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.710378:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.710406:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.710426:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520840 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.710648:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937408 00000100:00100000:3.0:1784756287.710653:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937408 00000100:00100000:3.0:1784756287.710686:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784756287.710693:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756287.711170:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 476us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.711177:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784756287.711820:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.711926:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.711972:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756287.712038:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761e7926c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756287.712069:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937536 00000100:00100000:1.0:1784756287.712074:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937536 00000100:00100000:1.0:1784756287.712133:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784756287.712140:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.712313:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756287.712320:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784756287.712387:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.713033:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8334:1871452489937664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.713082:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.713215:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761e7926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.713277:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937664 00000100:00100000:0.0:1784756287.713283:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937664 00000100:00100000:0.0:1784756287.713312:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784756287.713319:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:8334:x1871452489937664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.713526:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:8334:x1871452489937664:12345-0@lo:502:llog_process_th.0 Request processed in 207us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.713541:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784756287.713704:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8334:1871452489937664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756287.713736:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756287.713752:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756287.713754:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784756287.713761:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784756287.713786:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8334:1871452489937792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.713818:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.713853:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756287.713931:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937792 00000100:00100000:1.0:1784756287.713936:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937792 00000100:00100000:1.0:1784756287.713961:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784756287.713968:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:8334:x1871452489937792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756287.714102:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:8334:x1871452489937792:12345-0@lo:502:llog_process_th.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756287.714109:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784756287.714189:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8334:1871452489937792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756287.714206:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756287.714210:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756287.714212:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784756287.714215:0:8334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1784756287.714389:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784756287.714407:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784756287.714418:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023a5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.714430:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562200/0x1782e2377f0239e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023a5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756287.714440:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784756287.714442:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b761808f800 from 39 10000000:01000000:1.0:1784756287.714446:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784756287.714650:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.714659:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.714669:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.714684:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.714713:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.714742:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76065209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.714782:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489937920 00000100:00100000:0.0:1784756287.714787:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489937920 00000100:00100000:0.0:1784756287.714816:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784756287.714822:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489937920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756287.714840:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756287.714853:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6a000/0x1782e2377f023b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f023ac expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.714884:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6a000/0x1782e2377f023b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f023ac expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.714895:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6a000/0x1782e2377f023b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f023ac expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.714904:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a000, rc 0) 00000100:00100000:0.0:1784756287.714941:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489937920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.714946:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784756287.715069:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489937920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756287.715082:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023b3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.715090:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f023b3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756287.715138:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.715161:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.715180:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.715390:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938048 00000100:00100000:0.0:1784756287.715394:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938048 00000100:00100000:0.0:1784756287.715413:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784756287.715419:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489938048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.715781:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489938048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.715788:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784756287.715854:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.715883:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.715919:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.715944:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.716678:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938176 00000100:00100000:0.0:1784756287.716692:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938176 00000100:00100000:0.0:1784756287.716718:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784756287.716736:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489938176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.716913:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489938176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.716921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784756287.718805:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.719318:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8335:1871452489938304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.719707:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.720594:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76085cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.723668:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938304 00000100:00100000:0.0:1784756287.723685:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938304 00000100:00100000:0.0:1784756287.723764:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784756287.723775:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8335:x1871452489938304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.724104:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8335:x1871452489938304:12345-0@lo:502:llog_process_th.0 Request processed in 330us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.724112:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784756287.725280:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8335:1871452489938304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.725360:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8335:1871452489938432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.725418:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756287.725460:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763b9ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756287.725513:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938432 00000100:00100000:3.0:1784756287.725521:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938432 00000100:00100000:3.0:1784756287.725560:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784756287.725575:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8335:x1871452489938432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756287.725823:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8335:x1871452489938432:12345-0@lo:502:llog_process_th.0 Request processed in 248us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756287.725838:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784756287.725924:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8335:1871452489938432:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784756287.725943:0:8335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784756287.726102:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784756287.726120:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784756287.726130:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023b3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.726141:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562400/0x1782e2377f023ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023b3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756287.726162:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784756287.726164:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784756287.726167:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784756287.726194:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.726202:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.726211:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.726225:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.726254:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.726283:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76065209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756287.726393:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938560 00000100:00100000:2.0:1784756287.726397:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938560 00000100:00100000:2.0:1784756287.726431:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784756287.726439:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489938560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756287.726449:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756287.726463:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62000/0x1782e2377f023c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f023ba expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.726514:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62000/0x1782e2377f023c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f023ba expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.726524:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62000/0x1782e2377f023c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f023ba expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756287.726533:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62000, rc 0) 00000100:00100000:2.0:1784756287.726562:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489938560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756287.726578:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784756287.726770:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756287.726785:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023c1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756287.726794:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f023c1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756287.726840:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.726866:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.726890:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76065209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756287.727309:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938688 00000100:00100000:2.0:1784756287.727380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938688 00000100:00100000:2.0:1784756287.727450:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784756287.727458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489938688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756287.727763:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489938688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756287.727771:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784756287.727852:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.727887:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.727929:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.730036:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76065209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.730128:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938816 00000100:00100000:0.0:1784756287.730137:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938816 00000100:00100000:0.0:1784756287.730183:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784756287.730192:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489938816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.730434:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489938816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.730443:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784756287.730622:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489938816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756287.731119:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8336:1871452489938944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756287.731158:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.731185:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520840 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.731224:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489938944 00000100:00100000:0.0:1784756287.731229:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489938944 00000100:00100000:0.0:1784756287.731247:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784756287.731252:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8336:x1871452489938944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756287.731567:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8336:x1871452489938944:12345-0@lo:502:llog_process_th.0 Request processed in 313us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.731583:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784756287.731805:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8336:1871452489938944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784756287.731827:0:8336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756287.731907:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756287.731910:0:8336:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784756287.731915:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784756287.731935:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8336:1871452489939072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756287.731966:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756287.732015:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7606520840 going to sleep for 11 seconds 00000100:00100000:2.0:1784756287.732045:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939072 00000100:00100000:2.0:1784756287.732049:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939072 00000100:00100000:2.0:1784756287.732100:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784756287.732107:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8336:x1871452489939072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756287.732244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8336:x1871452489939072:12345-0@lo:502:llog_process_th.0 Request processed in 138us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756287.732250:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784756287.732305:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8336:1871452489939072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784756287.732329:0:8336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756287.732333:0:8336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756287.732334:0:8336:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784756287.732337:0:8336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784756287.732556:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784756287.732571:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784756287.732581:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023c1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.732591:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609563e00/0x1782e2377f023ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023c1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756287.732600:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784756287.732603:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b76104c8000 from 1 10000000:01000000:3.0:1784756287.732614:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784756287.732637:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.732645:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.732654:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756287.732667:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489939200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756287.732695:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756287.733013:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.733261:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939200 00000100:00100000:0.0:1784756287.733267:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939200 00000100:00100000:0.0:1784756287.733292:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784756287.733298:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489939200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756287.733307:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756287.733329:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6ae00/0x1782e2377f023cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f023c8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.733350:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6ae00/0x1782e2377f023cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f023c8 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.733359:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6ae00/0x1782e2377f023cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f023c8 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756287.733367:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6ae00, rc 0) 00000100:00100000:0.0:1784756287.733402:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489939200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756287.733408:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784756287.733569:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489939200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756287.733594:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.733603:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f023cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756287.733659:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756287.733687:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756287.733711:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756287.733811:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939328 00000100:00100000:0.0:1784756287.733815:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939328 00000100:00100000:0.0:1784756287.734417:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784756287.734429:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489939328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756287.734688:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489939328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1000us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784756287.734695:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784756287.735506:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489939328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784756287.735543:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784756287.735552:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756287.735562:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7601679600/0x1782e2377f023c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756288.526635:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756288.587322:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756288.587365:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756288.587392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756288.587425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756288.587521:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795712 00000100:00100000:0.0:1784756288.587544:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795712 00000100:00100000:1.0:1784756288.587548:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795456 00000100:00100000:1.0:1784756288.587551:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795456 00000100:00100000:0.0:1784756288.587623:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795584 00000100:00100000:0.0:1784756288.587626:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795584 00000100:00100000:2.0:1784756288.587647:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784756288.587663:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2354:x1871452465795712:12345-192.168.202.4@tcp:400: 00000100:00100000:2.0:1784756288.587755:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2354:x1871452465795712:12345-192.168.202.4@tcp:400: Request processed in 98us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756288.587763:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784756288.588049:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795328 00000100:00100000:2.0:1784756288.588054:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795328 00000100:00100000:2.0:1784756288.588097:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:2.0:1784756288.588121:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:2354:x1871452465795328:12345-192.168.202.4@tcp:400: 00000100:00100000:2.0:1784756288.588593:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+8:2354:x1871452465795328:12345-192.168.202.4@tcp:400: Request processed in 489us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756288.588618:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:1.0:1784756288.589527:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1784756288.589542:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465795456:12345-192.168.202.4@tcp:400: 00000100:00100000:1.0:1784756288.589596:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465795456:12345-192.168.202.4@tcp:400: Request processed in 58us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756288.589628:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:0.0:1784756288.589695:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1784756288.589704:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:2354:x1871452465795584:12345-192.168.202.4@tcp:400: 00000100:00100000:0.0:1784756288.589732:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:2354:x1871452465795584:12345-192.168.202.4@tcp:400: Request processed in 30us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756288.589738:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00080000:3.0:1784756288.590948:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756288.590956:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756288.590959:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756288.970981:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756288.971135:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795840 00000100:00100000:1.0:1784756288.971144:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795840 00000100:00100000:1.0:1784756288.971204:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:1.0:1784756288.971214:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+8:5569:x1871452465795840:12345-192.168.202.4@tcp:101: 00010000:00010000:1.0:1784756288.971241:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756288.971261:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609563a00/0x1782e2377f023d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763d6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756288.971290:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563a00/0x1782e2377f023d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763d6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756288.971301:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609563a00/0x1782e2377f023d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763d6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756288.971310:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609563a00, rc 0) 00000100:00100000:1.0:1784756288.971371:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465795840:12345-192.168.202.4@tcp:101: Request processed in 159us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756288.971389:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:1.0:1784756288.981407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756288.981909:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465795968 00000100:00100000:2.0:1784756288.981921:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465795968 00000100:00100000:2.0:1784756288.981987:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:2.0:1784756288.981998:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465795968:12345-192.168.202.4@tcp:501: 00000100:00100000:2.0:1784756288.982313:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465795968:12345-192.168.202.4@tcp:501: Request processed in 316us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756288.982322:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:3.0:1784756288.986865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756288.986946:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796096 00000100:00100000:2.0:1784756288.986957:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796096 00000100:00100000:2.0:1784756288.987019:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:2.0:1784756288.987029:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465796096:12345-192.168.202.4@tcp:503: 00000100:00100000:2.0:1784756288.987314:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465796096:12345-192.168.202.4@tcp:503: Request processed in 285us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756288.987322:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:3.0:1784756288.998764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756289.004724:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796224 00000100:00100000:1.0:1784756289.004739:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796224 00000100:00100000:1.0:1784756289.004827:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:1.0:1784756289.004838:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:6048:x1871452465796224:12345-192.168.202.4@tcp:502: 00000100:00100000:1.0:1784756289.005126:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:6048:x1871452465796224:12345-192.168.202.4@tcp:502: Request processed in 289us (6370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756289.005134:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:1.0:1784756289.010858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756289.011060:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796352 00000100:00100000:3.0:1784756289.011072:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796352 00000100:00100000:3.0:1784756289.011140:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:3.0:1784756289.011149:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:6048:x1871452465796352:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756289.011435:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:6048:x1871452465796352:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 286us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.011443:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:3.0:1784756289.020901:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756289.021606:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796480 00000100:00100000:2.0:1784756289.021618:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796480 00000100:00100000:2.0:1784756289.021678:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:2.0:1784756289.021689:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465796480:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756289.021705:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756289.021723:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f63200/0x1782e2377f023dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763dd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.021754:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f63200/0x1782e2377f023dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763dd expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.021786:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f63200/0x1782e2377f023dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763dd expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.021796:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63200, rc 0) 00000100:00100000:2.0:1784756289.021867:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796480:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 179us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756289.021875:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:2.0:1784756289.024609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756289.024847:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796608 00000100:00100000:1.0:1784756289.024858:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796608 00000100:00100000:1.0:1784756289.024914:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:1.0:1784756289.024924:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796608:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756289.025207:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796608:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 284us (617us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784756289.025216:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00010000:00010000:2.0:1784756289.551305:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784756289.823289:0:8374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca34a8bd0 20000000:00000080:3.0:1784756289.823312:0:8374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b7634231800 uarg=0000000000000000 20000000:01000000:3.0:1784756289.823352:0:8374:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784756289.823358:0:8374:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784756289.823369:0:8374:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784756289.824329:0:8375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784756289.826179:0:8374:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1784756289.833108:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1784756289.834961:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1784756289.835115:0:8374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1784756289.835384:0:8374:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784756289.835408:0:8374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835425:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02152 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835433:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f021b4 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835441:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0227f expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835450:0:8374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835458:0:8374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835724:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835742:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 9 pid: 5787 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.835758:0:8374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939456:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784756289.835912:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.835920:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 18 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.835929:0:8374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939584:0@lo:104: 00000100:00100000:2.0:1784756289.835968:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756289.836011:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.836028:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 18 pid: 5790 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.836037:0:8374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939712:0@lo:104: 00000100:00100000:2.0:1784756289.836060:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756289.836092:0:8374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756289.836100:0:8374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 18 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.836121:0:8374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939840:0@lo:104: 00000100:00100000:2.0:1784756289.836152:0:8374:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761e792f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784756289.838359:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784756289.838398:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756289.838425:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939584 00000100:00100000:3.0:1784756289.838433:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939584 00000100:00100000:3.0:1784756289.838486:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939712 00000100:00100000:3.0:1784756289.838490:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939712 00000100:00100000:3.0:1784756289.838500:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939840 00000100:00100000:3.0:1784756289.838503:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939840 00000100:00100000:3.0:1784756289.838516:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784756289.838524:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:8374:x1871452489939584:12345-0@lo:104: 00010000:00010000:3.0:1784756289.839332:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839425:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784756289.839432:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+5:8374:x1871452489939584:12345-0@lo:104: Request processed in 909us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.839440:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784756289.839510:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784756289.839517:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:8374:x1871452489939712:12345-0@lo:104: 00010000:00010000:3.0:1784756289.839527:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839576:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784756289.839581:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:8374:x1871452489939712:12345-0@lo:104: Request processed in 65us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.839597:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784756289.839633:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756289.839640:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:8374:x1871452489939840:12345-0@lo:104: 00010000:00010000:3.0:1784756289.839647:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839679:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784756289.839684:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:8374:x1871452489939840:12345-0@lo:104: Request processed in 45us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.839690:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1784756289.839710:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784756289.839716:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839724:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609562a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756289.839728:0:6614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839736:0:6614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756289.839754:0:6614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756289.839760:0:6614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756289.839796:0:6614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839803:0:6614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756289.839823:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839831:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f0227f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02286 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839845:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784756289.839848:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839854:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756289.839857:0:6614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839864:0:6614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756289.839870:0:6614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756289.839875:0:6614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756289.839896:0:6614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839902:0:6614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756289.839917:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839923:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f62600/0x1782e2377f021b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f021bb expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839931:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784756289.839934:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839940:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7600031a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1784756289.839943:0:6614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839949:0:6614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756289.839955:0:6614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756289.839960:0:6614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756289.839986:0:6614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.839992:0:6614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756289.839998:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840014:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7600031a00/0x1782e2377f02152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02159 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840028:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756289.840030:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756289.840031:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756289.840037:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756289.840042:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756289.840063:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489939968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756289.840097:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756289.840159:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489940096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756289.840186:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756289.840204:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756289.840211:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489940224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756289.840230:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756289.840259:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489939968 00000100:00100000:3.0:1784756289.840263:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489939968 00010000:00010000:3.0:1784756289.840286:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 19 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756289.840303:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940096 00000100:00100000:3.0:1784756289.840306:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940096 00010000:00010000:3.0:1784756289.840315:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 20 pid: 5790 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756289.840324:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940224 00000100:00100000:3.0:1784756289.840326:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940224 00010000:00010000:3.0:1784756289.840334:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 21 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756289.840353:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756289.840359:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3320:x1871452489939968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756289.840369:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756289.840374:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 21 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840382:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 21 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840399:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756289.840426:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+21:3320:x1871452489939968:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.840432:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756289.840447:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756289.840453:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3321:x1871452489940096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756289.840460:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756289.840464:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 20 pid: 5790 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840496:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 20 pid: 5790 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840506:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756289.840533:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3321:x1871452489940096:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.840539:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756289.840550:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756289.840560:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489940224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756289.840568:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756289.840572:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 19 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840579:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 19 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.840597:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756289.840617:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489940224:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.840622:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756289.840662:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7633c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489939968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756289.840686:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489940224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756289.840693:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489940096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756289.841136:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b76421eee00/0x1782e2377f02286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f0227f expref: 18 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.841162:0:8374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939584:0@lo:104: 00010000:00010000:2.0:1784756289.841173:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600030800/0x1782e2377f021bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f021b4 expref: 17 pid: 5790 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.841181:0:8374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76083b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939712:0@lo:104: 00010000:00010000:2.0:1784756289.841189:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7600031000/0x1782e2377f02159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02152 expref: 16 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756289.841198:0:8374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939840:0@lo:104: 00000100:00100000:2.0:1784756289.848947:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756289.849030:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796736 00000100:00100000:3.0:1784756289.849040:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796736 00010000:00010000:3.0:1784756289.849081:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 10 pid: 5787 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756289.849123:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1784756289.849133:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465796736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756289.849159:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756289.849166:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 10 pid: 5787 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849179:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 10 pid: 5787 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849215:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849224:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849238:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849245:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849251:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849258:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849263:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63400 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:3.0:1784756289.849267:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849275:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849284:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756289.849293:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756289.849350:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465796736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 218us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756289.849367:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00010000:00010000:0.0:1784756289.850136:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7640e6be00/0x1782e2377f02343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763a5 expref: 9 pid: 5787 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756289.851132:0:8374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7501151c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8374:1871452489939456:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784756289.851168:0:8374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756289.853782:0:8374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756289.853800:0:8374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756289.853806:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f63400/0x1782e2377f023e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756290.114865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756290.118233:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796864 00000100:00100000:2.0:1784756290.118249:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796864 00000100:00100000:2.0:1784756290.118397:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:2.0:1784756290.118409:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465796864:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756290.118426:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756290.118447:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763e4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756290.118492:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756290.118501:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756290.118519:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62200, rc 0) 00000100:00100000:2.0:1784756290.118601:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796864:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 195us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756290.118609:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:2.0:1784756290.122784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756290.123066:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465796992 00000100:00100000:3.0:1784756290.123077:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465796992 00000100:00100000:3.0:1784756290.123198:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:3.0:1784756290.123210:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796992:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756290.123607:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465796992:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 399us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756290.123616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:3.0:1784756290.128762:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756290.128860:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797120 00000100:00100000:2.0:1784756290.128869:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797120 00000100:00100000:2.0:1784756290.128965:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:2.0:1784756290.128976:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465797120:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756290.129198:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465797120:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 223us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756290.129207:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:2.0:1784756290.146815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756290.146969:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797248 00000100:00100000:3.0:1784756290.146979:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797248 00000100:00100000:3.0:1784756290.147035:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:3.0:1784756290.147046:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:6094:x1871452465797248:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756290.147249:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:6094:x1871452465797248:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 204us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756290.147257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:3.0:1784756290.149211:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756290.149351:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797376 00000100:00100000:2.0:1784756290.149360:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797376 00000100:00100000:2.0:1784756290.149409:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:2.0:1784756290.149419:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:6094:x1871452465797376:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784756290.149706:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:6094:x1871452465797376:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 288us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756290.149715:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1784756290.189774:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489940608:0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.189777:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489940352:0@lo:400:kworker.0 00000100:00100000:0.0:1784756290.189845:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489940480:0@lo:400:kworker.0 00000100:00100000:3.0:1784756290.189971:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756290.190038:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756290.190045:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489940736:0@lo:400:kworker.0 00000100:00100000:3.0:1784756290.190073:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756290.190125:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940608 00000100:00100000:3.0:1784756290.190132:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940608 00000100:00100000:3.0:1784756290.190183:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784756290.190220:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489940608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756290.190270:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489940608:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756290.190277:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1784756290.190311:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756290.190340:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489940608:0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.190841:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756290.190867:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489940864:0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.191247:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756290.191285:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940352 00000100:00100000:1.0:1784756290.191288:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940864 00000100:00100000:3.0:1784756290.191291:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940352 00000100:00100000:3.0:1784756290.191332:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784756290.191339:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3319:x1871452489940352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756290.191381:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3319:x1871452489940352:12345-0@lo:400:kworker.0 Request processed in 43us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756290.191388:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784756290.191463:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940864 00000100:00100000:1.0:1784756290.191520:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784756290.191526:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756290.191534:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940736 00000100:00100000:2.0:1784756290.191549:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940736 00000100:00100000:1.0:1784756290.191557:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489940864:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756290.191574:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756290.191579:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756290.191595:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489940736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.191615:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489940352:0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.191626:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489940864:0@lo:400:kworker.0 00000100:00100000:2.0:1784756290.191636:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489940736:12345-0@lo:400:kworker.0 Request processed in 52us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756290.191642:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756290.191662:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756290.191670:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756290.191696:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784756290.191748:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fec1c00 x1871452489940736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756290.191759:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489940736:0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.191789:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941120 00000100:00100000:1.0:1784756290.191794:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941120 00000100:00100000:1.0:1784756290.191827:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784756290.191833:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489941120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756290.191859:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784756290.192113:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756290.192118:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756290.194711:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756290.194761:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489941120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2925us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756290.194775:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1784756290.194847:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7608086d80 x1871452489941120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756290.194871:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756290.195394:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489940992:0@lo:400:kworker.0 00000100:00100000:0.0:1784756290.195431:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756290.195661:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940992 00000100:00100000:1.0:1784756290.195667:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940992 00000100:00100000:1.0:1784756290.195732:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756290.195742:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489940992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756290.195794:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489940992:12345-0@lo:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756290.195800:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784756290.195856:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756290.195918:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fec3100 x1871452489940992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756290.195930:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489940992:0@lo:400:kworker.0 00000100:00100000:2.0:1784756290.198388:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489940480 00000100:00100000:2.0:1784756290.198402:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489940480 00000100:00100000:2.0:1784756290.198561:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756290.198571:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489940480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756290.198677:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489940480:12345-0@lo:400:kworker.0 Request processed in 108us (3973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756290.198684:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756290.198770:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489940480:0@lo:400:kworker.0 00010000:00010000:2.0:1784756290.575618:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756290.703639:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489941248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756290.703715:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756290.703791:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941248 00000100:00100000:0.0:1784756290.703800:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941248 00000100:00100000:0.0:1784756290.703842:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784756290.703850:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489941248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756290.703881:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756290.703927:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489941248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756290.703933:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784756290.703972:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641100e00 x1871452489941248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756290.703990:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489941248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756291.598074:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784756291.726982:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756291.726990:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b7637cbf000 from 4 10000000:01000000:2.0:1784756291.726994:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756291.727045:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727057:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727069:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756291.727108:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.727175:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.727218:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7612978840 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.727456:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941376 00000100:00100000:2.0:1784756291.727463:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941376 00000100:00100000:2.0:1784756291.727529:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784756291.727538:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489941376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756291.727551:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756291.727564:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f023f2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727597:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f023f2 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727608:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f023f2 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727790:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62600, rc 0) 00000100:00100000:2.0:1784756291.727832:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489941376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.727839:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784756291.727890:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756291.727906:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.727914:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756291.727972:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.727998:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.728014:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7612978840 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.728027:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941504 00000100:00100000:2.0:1784756291.728030:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941504 00000100:00100000:2.0:1784756291.728053:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784756291.728059:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489941504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.729840:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489941504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1775us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.729852:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784756291.732007:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.732079:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.732150:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.732190:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.732205:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941632 00000100:00100000:2.0:1784756291.732214:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941632 00000100:00100000:2.0:1784756291.732352:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784756291.732367:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489941632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.732669:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489941632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.732678:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784756291.732685:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489941632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.734872:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8483:1871452489941760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756291.734937:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.734972:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.735220:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941760 00000100:00100000:2.0:1784756291.735227:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941760 00000100:00100000:2.0:1784756291.735270:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784756291.735291:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8483:x1871452489941760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.735900:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8483:x1871452489941760:12345-0@lo:502:llog_process_th.0 Request processed in 619us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.735909:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784756291.736006:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8483:1871452489941760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784756291.736035:0:8483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756291.736045:0:8483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756291.736048:0:8483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784756291.736054:0:8483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b7637cbf000 00000020:00000080:0.0:1784756291.736057:0:8483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784756291.736140:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8483:1871452489941888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756291.736180:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756291.736195:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173b240 going to sleep for 11 seconds 00000100:00100000:0.0:1784756291.741598:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489941888 00000100:00100000:0.0:1784756291.741610:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489941888 00000100:00100000:0.0:1784756291.741659:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784756291.741668:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8483:x1871452489941888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756291.741924:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:8483:x1871452489941888:12345-0@lo:502:llog_process_th.0 Request processed in 256us (5742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756291.741932:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784756291.741993:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8483:1871452489941888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784756291.742026:0:8483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756291.742034:0:8483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756291.742037:0:8483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784756291.742041:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784756291.750056:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784756291.750092:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756291.750115:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.750129:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756291.750139:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784756291.750141:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b760fc26000 from 4 10000000:01000000:1.0:1784756291.750144:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756291.750257:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.750267:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.750277:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756291.750305:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.750374:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.750516:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756291.750734:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942016 00000100:00100000:3.0:1784756291.750742:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942016 00000100:00100000:3.0:1784756291.750801:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784756291.750810:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489942016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756291.750824:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756291.750838:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02400 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756291.750873:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02400 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756291.750883:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02400 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756291.750892:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601679000, rc 0) 00000100:00100000:3.0:1784756291.750932:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756291.750938:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784756291.750988:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756291.751002:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756291.751010:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756291.751061:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756291.751154:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756291.751173:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7611b103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756291.752511:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942144 00000100:00100000:0.0:1784756291.752519:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942144 00000100:00100000:0.0:1784756291.752559:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784756291.752567:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756291.752828:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756291.752836:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784756291.752889:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756291.752930:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756291.752968:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756291.752993:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b761173bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756291.753781:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942272 00000100:00100000:1.0:1784756291.753788:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942272 00000100:00100000:1.0:1784756291.753819:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784756291.753826:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.753986:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756291.754000:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784756291.754044:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.754250:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8485:1871452489942400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756291.755061:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.755102:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942400 00000100:00100000:1.0:1784756291.755108:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942400 00000100:00100000:1.0:1784756291.755136:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784756291.755143:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8485:x1871452489942400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756291.755358:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8485:x1871452489942400:12345-0@lo:502:llog_process_th.0 Request processed in 215us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756291.755365:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784756291.755923:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.755950:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8485:1871452489942400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756291.755981:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756291.755990:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756291.755993:0:8485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784756291.756000:0:8485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b760fc26000 00000020:00000080:2.0:1784756291.756003:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756291.756122:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8485:1871452489942528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.756162:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.756189:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7612978a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756291.756235:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942528 00000100:00100000:1.0:1784756291.756240:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942528 00000100:00100000:1.0:1784756291.756371:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784756291.756380:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8485:x1871452489942528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756291.756566:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:8485:x1871452489942528:12345-0@lo:502:llog_process_th.0 Request processed in 186us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756291.756583:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784756291.757349:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8485:1871452489942528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756291.757377:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756291.757383:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756291.757384:0:8485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784756291.757389:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784756291.757697:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784756291.757717:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756291.757729:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.757741:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756291.757764:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784756291.757766:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b761808f800 from 4 10000000:01000000:1.0:1784756291.757769:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756291.757797:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.757805:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.757814:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756291.757830:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.757867:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.757903:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543be40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.757951:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942656 00000100:00100000:2.0:1784756291.757957:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942656 00000100:00100000:2.0:1784756291.758001:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784756291.758010:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489942656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756291.758021:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756291.758034:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0240e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.758058:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.758069:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.758079:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62e00, rc 0) 00000100:00100000:2.0:1784756291.758121:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489942656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.758127:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784756291.758162:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756291.758175:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756291.758184:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756291.758229:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.758254:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.758267:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b76129786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.758350:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942784 00000100:00100000:2.0:1784756291.758354:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942784 00000100:00100000:2.0:1784756291.758376:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784756291.758383:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489942784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.758847:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489942784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 463us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.758856:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784756291.758961:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.758990:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756291.759027:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756291.759087:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b760543be40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.759117:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489942912 00000100:00100000:2.0:1784756291.759121:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489942912 00000100:00100000:2.0:1784756291.759179:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784756291.759187:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489942912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.759372:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489942912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.759378:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784756291.759764:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489942912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756291.760174:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8486:1871452489943040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.760212:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.760234:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943040 00000100:00100000:2.0:1784756291.760238:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943040 00000100:00100000:2.0:1784756291.760270:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784756291.760375:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:8486:x1871452489943040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.760720:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:8486:x1871452489943040:12345-0@lo:502:llog_process_th.0 Request processed in 442us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.760726:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784756291.760762:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7612978480 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.760776:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8486:1871452489943040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756291.760796:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756291.760804:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756291.760806:0:8486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784756291.760812:0:8486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b761808f800 00000020:00000080:2.0:1784756291.760814:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756291.760928:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8486:1871452489943168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.760959:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756291.760978:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943168 00000100:00100000:2.0:1784756291.760982:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943168 00000100:00100000:2.0:1784756291.761008:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784756291.761014:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:8486:x1871452489943168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756291.761115:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:8486:x1871452489943168:12345-0@lo:502:llog_process_th.0 Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756291.761121:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784756291.761147:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7640e74000 going to sleep for 11 seconds 00000100:00100000:2.0:1784756291.761159:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c73f41-e9a1-4359-8051-7c5e1edb844a:8486:1871452489943168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756291.761181:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756291.761185:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756291.761187:0:8486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784756291.761191:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784756291.761587:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784756291.761611:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756291.761669:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756291.761681:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756292.624691:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756293.648979:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756293.717980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756293.718031:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756293.718057:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756293.718080:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756293.718112:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797760 00000100:00100000:3.0:1784756293.718121:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797760 00000100:00100000:3.0:1784756293.718184:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797888 00000100:00100000:3.0:1784756293.718187:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797888 00000100:00100000:1.0:1784756293.718279:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797504 00000100:00100000:1.0:1784756293.718288:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797504 00000100:00100000:1.0:1784756293.718319:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:1.0:1784756293.718329:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465797504:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756293.718399:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465797504:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 71us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756293.718406:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:3.0:1784756293.718586:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784756293.718659:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465797760:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756293.718687:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465797760:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756293.718693:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784756293.718711:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784756293.718718:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465797888:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756293.718740:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465797888:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756293.718745:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784756293.718765:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465797632 00000100:00100000:3.0:1784756293.718768:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465797632 00000100:00100000:3.0:1784756293.718798:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1784756293.718804:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465797632:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756293.718833:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465797632:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756293.718840:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00080000:3.0:1784756293.718860:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756293.718864:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756293.718866:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784756294.669628:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756295.072381:0:8675:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1784756295.310525:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489943296:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310611:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310671:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489943808:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310696:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310720:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784756295.310726:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489943424:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310747:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310765:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489943936:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310787:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310817:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489943552:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310839:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310855:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756295.310861:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489943680:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.310882:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756295.310912:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943296 00000100:00100000:1.0:1784756295.310919:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943296 00000100:00100000:1.0:1784756295.310962:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784756295.310970:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489943296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.311035:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489943296:12345-0@lo:400:kworker.0 Request processed in 65us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756295.311044:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784756295.311094:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489943296:0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311400:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943936 00000100:00100000:0.0:1784756295.311405:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943936 00000100:00100000:0.0:1784756295.311448:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943680 00000100:00100000:0.0:1784756295.311452:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943680 00000100:00100000:0.0:1784756295.311490:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784756295.311505:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489943936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311556:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489943936:12345-0@lo:400:kworker.0 Request processed in 52us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756295.311563:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784756295.311575:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784756295.311581:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311618:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489943680:12345-0@lo:400:kworker.0 Request processed in 36us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756295.311624:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784756295.311642:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943808 00000100:00100000:0.0:1784756295.311645:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943808 00000100:00100000:0.0:1784756295.311666:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943424 00000100:00100000:0.0:1784756295.311668:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943424 00000100:00100000:0.0:1784756295.311677:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489943552 00000100:00100000:0.0:1784756295.311680:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489943552 00000100:00100000:0.0:1784756295.311693:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784756295.311699:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311729:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489943808:12345-0@lo:400:kworker.0 Request processed in 30us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756295.311736:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784756295.311747:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784756295.311752:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489943424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311777:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489943424:12345-0@lo:400:kworker.0 Request processed in 25us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756295.311782:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784756295.311792:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756295.311798:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489943552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756295.311830:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489943552:12345-0@lo:400:kworker.0 Request processed in 32us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756295.311835:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1784756295.312873:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756295.312880:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784756295.312882:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784756295.312922:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e70a80 x1871452489943680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756295.312938:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489943680:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.312951:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489943552:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.312989:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489943424:0@lo:400:kworker.0 00010000:00080000:1.0:1784756295.313000:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e71880 x1871452489943936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756295.313010:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489943936:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.313020:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489943808:0@lo:400:kworker.0 00000100:00100000:1.0:1784756295.313262:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489944064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756295.313301:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756295.314495:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944064 00000100:00100000:2.0:1784756295.314504:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944064 00000100:00100000:2.0:1784756295.314558:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756295.314566:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489944064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756295.314596:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756295.314695:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489944064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756295.314702:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1784756295.315965:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7608085f80 x1871452489944064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756295.315988:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489944064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756295.695027:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756295.821650:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489944192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756295.821721:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756295.821836:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944192 00000100:00100000:3.0:1784756295.821845:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944192 00000100:00100000:3.0:1784756295.821901:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784756295.821911:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489944192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756295.821953:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756295.822000:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489944192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756295.822008:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1784756295.822288:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102a00 x1871452489944192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756295.822315:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489944192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756296.719765:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756297.742693:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756298.765682:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756298.829525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756298.829578:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756298.829610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756298.829648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756298.829684:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798016 00000100:00100000:3.0:1784756298.829697:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798016 00000100:00100000:3.0:1784756298.829888:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:3.0:1784756298.829901:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465798016:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756298.829999:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465798016:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 101us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756298.830008:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:3.0:1784756298.830063:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798272 00000100:00100000:3.0:1784756298.830067:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798272 00000100:00100000:3.0:1784756298.830108:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798400 00000100:00100000:3.0:1784756298.830112:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798400 00000100:00100000:3.0:1784756298.830136:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784756298.830144:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465798272:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756298.830174:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465798272:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756298.830181:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784756298.830194:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1784756298.830200:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465798400:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756298.830243:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465798400:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756298.830251:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1784756298.830272:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798144 00000100:00100000:3.0:1784756298.830275:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798144 00000100:00100000:3.0:1784756298.830309:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784756298.830316:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465798144:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756298.830345:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465798144:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756298.830352:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00080000:3.0:1784756298.830528:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756298.830534:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756298.830536:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1784756299.579027:0:8919:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing yml_node 00010000:00010000:1.0:1784756299.792914:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756300.430161:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489944320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430236:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430285:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489944832:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430311:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430338:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784756300.430344:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489944448:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430363:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430376:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489944960:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430398:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430425:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489944704:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430448:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430462:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756300.430488:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489944576:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430548:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.430575:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944320 00000100:00100000:0.0:1784756300.430582:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944320 00000100:00100000:0.0:1784756300.430620:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784756300.430628:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430674:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489944320:12345-0@lo:400:kworker.0 Request processed in 46us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.430682:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784756300.430724:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944832 00000100:00100000:0.0:1784756300.430729:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944832 00000100:00100000:0.0:1784756300.430754:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944448 00000100:00100000:0.0:1784756300.430757:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944448 00000100:00100000:0.0:1784756300.430768:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944576 00000100:00100000:0.0:1784756300.430771:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944576 00000100:00100000:0.0:1784756300.430783:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756300.430788:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489944832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430817:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489944832:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.430822:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756300.430833:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756300.430837:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489944448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430859:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489944448:12345-0@lo:400:kworker.0 Request processed in 22us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.430864:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756300.430875:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756300.430880:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489944576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430908:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489944576:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.430918:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756300.430953:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489944576:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430977:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489944448:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430985:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489944320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.430993:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489944832:0@lo:400:kworker.0 00000100:00100000:3.0:1784756300.431552:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944960 00000100:00100000:3.0:1784756300.431557:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944960 00000100:00100000:3.0:1784756300.431626:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489944704 00000100:00100000:3.0:1784756300.431629:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489944704 00000100:00100000:3.0:1784756300.431651:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756300.431658:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489944960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.431877:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756300.431886:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7501151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489944704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756300.431928:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7501151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489944704:12345-0@lo:400:kworker.0 Request processed in 44us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.431935:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1784756300.431971:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641101500 x1871452489944704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756300.431983:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489944704:0@lo:400:kworker.0 00000100:00100000:3.0:1784756300.432194:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489944960:12345-0@lo:400:kworker.0 Request processed in 536us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756300.432215:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1784756300.432243:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756300.432247:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756300.432249:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784756300.432534:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641100a80 x1871452489944960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756300.432546:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489944960:0@lo:400:kworker.0 00000100:00100000:2.0:1784756300.435083:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756300.435103:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489945088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756300.435167:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756300.435304:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945088 00000100:00100000:3.0:1784756300.435312:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945088 00000100:00100000:3.0:1784756300.435365:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784756300.435382:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489945088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756300.435419:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756300.435464:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489945088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756300.435501:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784756300.436325:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7608086d80 x1871452489945088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756300.436348:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7608086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489945088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756300.813757:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756300.943072:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756300.943420:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489945216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756300.943539:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756300.944079:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945216 00000100:00100000:0.0:1784756300.944090:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945216 00000100:00100000:0.0:1784756300.944305:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784756300.944315:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489945216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756300.944352:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756300.944431:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489945216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756300.944439:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1784756300.944527:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641100a80 x1871452489945216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756300.944546:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489945216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756301.838730:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756302.861662:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756303.128283:0:9112:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00010000:00010000:1.0:1784756303.886130:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756303.967442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756303.967641:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798528 00000100:00100000:2.0:1784756303.967652:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798528 00000100:00100000:2.0:1784756303.967820:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:2.0:1784756303.967832:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465798528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784756303.967906:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465798528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756303.967914:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:2.0:1784756303.967984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756303.968024:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798656 00000100:00100000:1.0:1784756303.968030:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798656 00000100:00100000:1.0:1784756303.968077:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1784756303.968085:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465798656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756303.968128:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465798656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756303.968135:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1784756303.968152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:1.0:1784756303.968154:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756303.968213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756303.968238:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798784 00000100:00100000:0.0:1784756303.968244:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798784 00000100:00080000:1.0:1784756303.968285:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756303.968302:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465798912 00000100:00100000:0.0:1784756303.968306:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465798912 00000100:00100000:0.0:1784756303.968332:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1784756303.968340:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:2352:x1871452465798784:12345-192.168.202.4@tcp:9:kworker.0 00000100:00080000:1.0:1784756303.968360:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1784756303.968367:0:6910:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1782e2377f02351 00000100:00080000:0.0:1784756303.968378:0:6910:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf7000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784756303.968411:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784756303.968421:0:6910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784756303.968515:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1784756303.968525:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:2352:x1871452465798912:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1784756303.968546:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1782e2377f02358 00000100:00080000:1.0:1784756303.968554:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8b7637cf6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784756303.968584:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1784756303.968824:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+2:2352:x1871452465798784:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 485us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756303.968832:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00010000:00010000:0.0:1784756303.968968:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756303.969231:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+2:2352:x1871452465798912:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 707us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756303.969239:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00010000:00010000:0.0:1784756304.909646:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756305.369269:0:9209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00000100:00100000:0.0:1784756305.550420:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489945344:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550525:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550573:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489945856:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550621:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550652:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784756305.550658:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489945472:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550680:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550698:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489945984:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550722:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550762:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489945600:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550785:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550802:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756305.550807:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489945728:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.550828:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756305.550860:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945344 00000100:00100000:0.0:1784756305.550866:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945344 00000100:00100000:0.0:1784756305.550912:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784756305.553458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489945344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.553567:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489945344:12345-0@lo:400:kworker.0 Request processed in 130us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.553575:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784756305.553628:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945856 00000100:00100000:0.0:1784756305.553635:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945856 00000100:00100000:0.0:1784756305.553678:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945472 00000100:00100000:0.0:1784756305.553682:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945472 00000100:00100000:0.0:1784756305.553693:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945600 00000100:00100000:0.0:1784756305.553696:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945600 00000100:00100000:0.0:1784756305.553710:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756305.553716:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489945856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.553751:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489945856:12345-0@lo:400:kworker.0 Request processed in 35us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.553757:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756305.553768:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756305.553774:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489945472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.553800:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489945472:12345-0@lo:400:kworker.0 Request processed in 26us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.553816:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756305.553829:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756305.553835:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763faddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489945600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.553869:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763faddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489945600:12345-0@lo:400:kworker.0 Request processed in 34us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.553875:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756305.553896:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945984 00000100:00100000:0.0:1784756305.553900:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945984 00000100:00100000:0.0:1784756305.556063:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489945728 00000100:00100000:0.0:1784756305.556073:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489945728 00000100:00100000:0.0:1784756305.556115:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756305.556124:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489945984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556493:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489945984:12345-0@lo:400:kworker.0 Request processed in 369us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.556501:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756305.556519:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756305.556526:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763faded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489945728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556562:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763faded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489945728:12345-0@lo:400:kworker.0 Request processed in 36us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.556567:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756305.556633:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489945472:0@lo:400:kworker.0 00010000:00080000:0.0:1784756305.556649:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641100a80 x1871452489945984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756305.556659:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489945984:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556670:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489945344:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556695:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489945856:0@lo:400:kworker.0 00000100:00080000:0.0:1784756305.556727:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756305.556732:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756305.556735:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756305.556751:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763b8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489946112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756305.556785:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784756305.556816:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102d80 x1871452489945728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756305.556825:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489945728:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556836:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489945600:0@lo:400:kworker.0 00000100:00100000:0.0:1784756305.556868:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946112 00000100:00100000:0.0:1784756305.556872:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946112 00000100:00100000:0.0:1784756305.556896:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784756305.556902:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489946112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756305.556941:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756305.556978:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489946112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756305.556985:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1784756305.557010:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763b8aca80 x1871452489946112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756305.557024:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763b8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489946112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756305.949700:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756306.064046:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489946240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756306.064118:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756306.064259:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946240 00000100:00100000:0.0:1784756306.064267:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946240 00000100:00100000:0.0:1784756306.064333:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756306.064350:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489946240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756306.064386:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756306.065004:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489946240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 661us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756306.065013:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1784756306.065276:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fadea00 x1871452489946240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756306.065297:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489946240:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1784756306.681142:0:6625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00000020:00000080:1.0:1784756306.681154:0:6625:0:(genops.c:906:class_export_put()) final put ffff8b7637cf1800/8bab229c-803d-40e3-a820-b17a4715ff86 00000020:00000080:2.0:1784756306.681276:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8b7637cf1800/8bab229c-803d-40e3-a820-b17a4715ff86 for lustre-OST0000 00000020:00000080:2.0:1784756306.681329:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b7637cf7000 for lustre-OST0000 00010000:00010000:0.0:1784756306.957939:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756307.579106:0:9307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00010000:00010000:0.0:1784756307.984125:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784756308.161689:0:7515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00000020:00000080:0.0:1784756308.161699:0:7515:0:(genops.c:906:class_export_put()) final put ffff8b7637cf3800/8bab229c-803d-40e3-a820-b17a4715ff86 00000020:00000080:1.0:1784756308.161764:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8b7637cf3800/8bab229c-803d-40e3-a820-b17a4715ff86 for lustre-OST0001 00000020:00000080:1.0:1784756308.161814:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b7637cf6000 for lustre-OST0001 00010000:00010000:1.0:1784756309.005801:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756309.079032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756309.079083:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756309.079204:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799040 00000100:00100000:2.0:1784756309.079214:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799040 00000100:00100000:3.0:1784756309.079222:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799168 00000100:00100000:3.0:1784756309.079228:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799168 00000100:00100000:2.0:1784756309.079279:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:3.0:1784756309.079289:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:2.0:1784756309.079295:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465799040:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756309.079305:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465799168:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:0.0:1784756309.079377:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756309.079450:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465799168:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756309.079458:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:2.0:1784756309.085721:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465799040:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 6417us (6622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756309.085737:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 197 00000001:02000400:2.0:1784756309.249335:0:9356:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Jul 22 17:38:27 EDT 2026 00010000:00010000:0.0:1784756310.029724:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756310.669705:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489946496:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.669784:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.669849:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489947008:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.669877:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.669908:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784756310.669914:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489946368:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.669941:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.669961:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489946880:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.669997:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.670025:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489946624:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.670064:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.670084:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756310.670090:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489946752:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.670128:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756310.670163:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946496 00000100:00100000:3.0:1784756310.670171:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946496 00000100:00100000:3.0:1784756310.670210:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946880 00000100:00100000:3.0:1784756310.670213:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946880 00000100:00100000:3.0:1784756310.670820:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946624 00000100:00100000:3.0:1784756310.670825:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946624 00000100:00100000:3.0:1784756310.670844:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784756310.670851:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489946496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.670909:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489946496:12345-0@lo:400:kworker.0 Request processed in 57us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756310.670916:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784756310.670937:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756310.670943:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489946880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.670970:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489946880:12345-0@lo:400:kworker.0 Request processed in 27us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756310.671000:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756310.671014:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784756310.671020:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489946624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.671052:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489946624:12345-0@lo:400:kworker.0 Request processed in 32us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756310.671058:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784756310.671078:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947008 00000100:00100000:3.0:1784756310.671082:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947008 00000100:00080000:0.0:1784756310.671208:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756310.671214:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756310.671223:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946752 00000100:00100000:0.0:1784756310.671227:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946752 00000100:00100000:0.0:1784756310.671270:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756310.671276:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489947008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756310.671311:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489947008:12345-0@lo:400:kworker.0 Request processed in 36us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756310.671318:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756310.671331:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784756310.671337:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489946752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756310.671363:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489946752:12345-0@lo:400:kworker.0 Request processed in 27us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756310.671369:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1784756310.671391:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756310.671963:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489946368 00000100:00100000:3.0:1784756310.671969:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489946368 00000100:00100000:3.0:1784756310.672067:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784756310.672075:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489946368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756310.672199:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756310.672215:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763b8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489947136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756310.672264:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756310.672299:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947136 00000100:00100000:0.0:1784756310.672302:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947136 00000100:00100000:0.0:1784756310.672328:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756310.672334:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489947136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756310.672362:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756310.672409:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489947136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756310.672416:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1784756310.672454:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763b8ad880 x1871452489947136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756310.672491:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763b8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489947136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756310.672628:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489946368:12345-0@lo:400:kworker.0 Request processed in 554us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756310.672636:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:3.0:1784756310.672693:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fec1c00 x1871452489946752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756310.672703:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489946752:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.672715:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489946624:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.672742:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489946368:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.672754:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489946880:0@lo:400:kworker.0 00000100:00100000:3.0:1784756310.672763:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489946496:0@lo:400:kworker.0 00010000:00080000:3.0:1784756310.672774:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fec0700 x1871452489947008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756310.672793:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489947008:0@lo:400:kworker.0 00010000:00010000:0.0:1784756311.054550:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756311.185934:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489947264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756311.186003:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756311.186070:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947264 00000100:00100000:0.0:1784756311.186077:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947264 00000100:00100000:0.0:1784756311.186119:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756311.186128:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489947264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756311.186161:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756311.186204:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489947264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756311.186212:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1784756311.186258:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fadd500 x1871452489947264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756311.186277:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489947264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756312.088789:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756313.101757:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756314.126901:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756314.186640:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756314.186680:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756314.186712:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799424 00000100:00100000:0.0:1784756314.186721:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799424 00000100:00100000:0.0:1784756314.186777:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:0.0:1784756314.186786:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465799424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756314.186849:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465799424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756314.186856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00080000:0.0:1784756314.186873:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756314.187124:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799296 00000100:00100000:3.0:1784756314.187128:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799296 00000100:00100000:3.0:1784756314.187162:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 199 00000100:00100000:3.0:1784756314.187168:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465799296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756314.187196:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465799296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756314.187202:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 199 00010000:00010000:1.0:1784756315.149709:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756315.790031:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489947520:0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.790113:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756315.790162:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756315.790169:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489947392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756315.790627:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756315.790668:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947520 00000100:00100000:3.0:1784756315.790676:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947520 00000100:00100000:3.0:1784756315.790719:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784756315.790728:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489947520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.790789:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489947520:12345-0@lo:400:kworker.0 Request processed in 62us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756315.790797:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784756315.790833:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947392 00000100:00100000:3.0:1784756315.790837:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947392 00000100:00100000:3.0:1784756315.790867:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756315.790874:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489947392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756315.791031:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756315.791161:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489947392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 286us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756315.791168:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1784756315.791275:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76116d8e00 x1871452489947392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756315.791294:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489947392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756315.791304:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489947520:0@lo:400:kworker.0 00000100:00080000:3.0:1784756315.791330:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756315.792735:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489947776:0@lo:400:kworker.0 00000100:00100000:0.0:1784756315.792797:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756315.792824:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756315.792830:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489947648:0@lo:400:kworker.0 00000100:00100000:0.0:1784756315.792851:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756315.792877:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947776 00000100:00100000:3.0:1784756315.793095:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489947904:0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793124:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756315.793147:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756315.793153:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793178:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756315.793221:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947648 00000100:00100000:3.0:1784756315.793225:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947648 00000100:00100000:3.0:1784756315.793254:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489947904 00000100:00100000:3.0:1784756315.793257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947904 00000100:00100000:3.0:1784756315.793282:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784756315.793291:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763faddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489947648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763faddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489947648:12345-0@lo:400:kworker.0 Request processed in 47us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756315.793344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784756315.793376:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784756315.793383:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489947904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793428:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489947904:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756315.793434:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784756315.793457:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948032 00000100:00100000:3.0:1784756315.793460:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948032 00000100:00100000:3.0:1784756315.793609:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784756315.793615:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489948032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793643:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489948032:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756315.793648:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784756315.793664:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756315.793668:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756315.793690:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489947648:0@lo:400:kworker.0 00010000:00080000:3.0:1784756315.793722:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fadc700 x1871452489948032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756315.793733:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784756315.793742:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489947904:0@lo:400:kworker.0 00000100:00100000:0.0:1784756315.794146:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489947776 00000100:00100000:0.0:1784756315.794196:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784756315.794202:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489947776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756315.794237:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489947776:12345-0@lo:400:kworker.0 Request processed in 35us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756315.794251:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1784756315.794530:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756315.794556:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489947776:0@lo:400:kworker.0 00010000:00010000:0.0:1784756316.174453:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756316.305381:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756316.305405:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489948160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756316.305494:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756316.305563:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948160 00000100:00100000:1.0:1784756316.305571:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948160 00000100:00100000:1.0:1784756316.305630:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756316.305640:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489948160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756316.305675:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756316.305719:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489948160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756316.305726:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1784756316.305769:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73800 x1871452489948160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756316.305788:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489948160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756317.197565:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756318.229131:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756319.249407:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756319.314658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756319.314692:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756319.314712:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799680 00000100:00100000:0.0:1784756319.314720:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799680 00000100:00100000:0.0:1784756319.314767:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1784756319.314774:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465799680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756319.314831:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465799680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756319.314837:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1784756319.314855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799552 00000100:00100000:0.0:1784756319.314857:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799552 00000100:00100000:0.0:1784756319.314885:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:0.0:1784756319.314892:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465799552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756319.314918:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465799552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756319.314924:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00080000:0.0:1784756319.314949:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756320.285372:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756320.909828:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489948672:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.909917:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.909986:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784756320.909992:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489948288:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910025:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.910060:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489948800:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910085:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.910113:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489948416:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910134:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.910152:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489948928:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910173:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.910190:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756320.910195:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489948544:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910229:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.910260:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948288 00000100:00100000:3.0:1784756320.910268:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948288 00000100:00100000:3.0:1784756320.910325:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784756320.910335:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489948288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910392:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489948288:12345-0@lo:400:kworker.0 Request processed in 59us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910400:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784756320.910439:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948800 00000100:00100000:3.0:1784756320.910442:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948800 00000100:00100000:3.0:1784756320.910631:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948416 00000100:00100000:3.0:1784756320.910635:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948416 00000100:00100000:3.0:1784756320.910648:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948544 00000100:00100000:3.0:1784756320.910651:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948544 00000100:00100000:3.0:1784756320.910663:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784756320.910668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489948800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910709:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489948800:12345-0@lo:400:kworker.0 Request processed in 40us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910714:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784756320.910734:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784756320.910740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489948416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910771:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489948416:12345-0@lo:400:kworker.0 Request processed in 32us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910778:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784756320.910788:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784756320.910794:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489948544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910818:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489948544:12345-0@lo:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910823:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784756320.910844:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948672 00000100:00100000:3.0:1784756320.910847:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948672 00000100:00100000:3.0:1784756320.910870:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489948928 00000100:00100000:3.0:1784756320.910873:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489948928 00000100:00100000:3.0:1784756320.910891:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784756320.910896:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489948672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910925:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489948672:12345-0@lo:400:kworker.0 Request processed in 28us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910930:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784756320.910942:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784756320.910948:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489948928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.910973:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489948928:12345-0@lo:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756320.910978:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1784756320.911000:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756320.911004:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756320.911007:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756320.911060:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489949056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756320.911088:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756320.911142:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489948544:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.911152:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489948416:0@lo:400:kworker.0 00010000:00080000:3.0:1784756320.911164:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e71f80 x1871452489948928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756320.911174:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489948928:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.911202:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489948288:0@lo:400:kworker.0 00000100:00100000:3.0:1784756320.911211:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489948800:0@lo:400:kworker.0 00010000:00080000:3.0:1784756320.911219:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73b80 x1871452489948672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756320.911228:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489948672:0@lo:400:kworker.0 00000100:00100000:1.0:1784756320.911589:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949056 00000100:00100000:1.0:1784756320.911594:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949056 00000100:00100000:1.0:1784756320.911627:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784756320.911635:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489949056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756320.911665:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756320.911709:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489949056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756320.911723:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1784756320.911751:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76116d8700 x1871452489949056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756320.911766:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489949056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756321.295134:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756321.423570:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756321.423593:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489949184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756321.423664:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756321.423957:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949184 00000100:00100000:1.0:1784756321.423965:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949184 00000100:00100000:1.0:1784756321.424021:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784756321.424032:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489949184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756321.424071:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756321.424134:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489949184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756321.424142:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1784756321.424937:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e72680 x1871452489949184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756321.424975:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489949184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756322.321434:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756323.345280:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756324.366816:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756324.437578:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756324.437725:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799808 00000100:00100000:2.0:1784756324.437745:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799808 00000100:00100000:2.0:1784756324.437803:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:2.0:1784756324.437813:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465799808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784756324.437877:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465799808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756324.437883:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:0.0:1784756324.446619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756324.446783:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465799936 00000100:00100000:3.0:1784756324.446794:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465799936 00000100:00100000:3.0:1784756324.446879:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:3.0:1784756324.446902:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2353:x1871452465799936:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756324.446996:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2353:x1871452465799936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756324.447005:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00080000:0.0:1784756324.448142:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1784756325.368657:0:10086:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682551 <= 34618625) for LU-18938, skip 360 00010000:00010000:0.0:1784756325.389698:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756326.029812:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489949568:0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.029886:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756326.030834:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784756326.030846:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489949440:0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.030875:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756326.030894:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489949952:0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.030930:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756326.030975:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949952 00000100:00100000:1.0:1784756326.030982:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949952 00000100:00100000:1.0:1784756326.031040:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784756326.031063:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489949952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.031116:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489949952:12345-0@lo:400:kworker.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756326.031122:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784756326.031163:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73800 x1871452489949952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756326.031176:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489949952:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031349:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489949696:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031376:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756326.031401:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784756326.031406:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489949312:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031438:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756326.031458:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489949824:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031497:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756326.031518:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949312 00000100:00100000:2.0:1784756326.031521:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949312 00000100:00100000:2.0:1784756326.031546:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784756326.031551:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489949312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031582:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489949312:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756326.031588:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784756326.031620:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489949312:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031644:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949568 00000100:00100000:2.0:1784756326.031648:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949568 00000100:00100000:2.0:1784756326.031666:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949440 00000100:00100000:2.0:1784756326.031668:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949440 00000100:00100000:2.0:1784756326.031677:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949824 00000100:00100000:2.0:1784756326.031679:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949824 00000100:00100000:2.0:1784756326.031692:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784756326.031697:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489949568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.031730:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489949568:12345-0@lo:400:kworker.0 Request processed in 32us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756326.031737:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784756326.031748:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756326.031753:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489949440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.031776:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489949696 00000100:00100000:2.0:1784756326.031779:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489949440:12345-0@lo:400:kworker.0 Request processed in 25us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756326.031780:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489949696 00000100:00100000:2.0:1784756326.031792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756326.031803:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756326.031803:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784756326.031809:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489949824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756326.031809:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489949696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784756326.031887:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756326.031893:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756326.031895:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756326.031927:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489949440:0@lo:400:kworker.0 00000100:00100000:0.0:1784756326.031939:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489949568:0@lo:400:kworker.0 00000100:00100000:2.0:1784756326.032408:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489949824:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756326.032416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756326.032416:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489949696:12345-0@lo:400:kworker.0 Request processed in 607us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756326.032422:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784756326.032448:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489949824:0@lo:400:kworker.0 00010000:00080000:2.0:1784756326.032460:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73b80 x1871452489949696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756326.032495:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489949696:0@lo:400:kworker.0 00000100:00100000:0.0:1784756326.032836:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489950080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756326.032875:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756326.033031:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950080 00000100:00100000:3.0:1784756326.033038:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950080 00000100:00100000:3.0:1784756326.033079:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784756326.033100:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489950080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756326.033131:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756326.033179:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489950080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756326.033185:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784756326.033418:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76116d9f80 x1871452489950080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756326.033435:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489950080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756326.413621:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756326.542051:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489950208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756326.542124:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756326.542243:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950208 00000100:00100000:1.0:1784756326.542251:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950208 00000100:00100000:1.0:1784756326.542313:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784756326.542322:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489950208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756326.542358:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756326.542947:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489950208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 624us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756326.542955:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1784756326.544902:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73800 x1871452489950208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756326.544930:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489950208:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1784756326.742133:0:10134:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682551 < 34486116) for LU-14927, skip 0f 00010000:00010000:1.0:1784756327.438617:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756328.197441:0:10182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682551 < 34681754) for LU-12550, skip 216 00010000:00010000:0.0:1784756328.461645:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756329.485630:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756329.554807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756329.554936:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800064 00000100:00100000:1.0:1784756329.554948:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800064 00000100:00100000:1.0:1784756329.555009:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:1.0:1784756329.555020:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465800064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756329.555102:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465800064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756329.555111:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:2.0:1784756329.563299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756329.563371:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800192 00000100:00100000:0.0:1784756329.563382:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800192 00000100:00100000:0.0:1784756329.563464:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1784756329.563498:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465800192:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756329.563573:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465800192:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756329.563580:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00080000:2.0:1784756329.564197:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1784756329.843587:0:10230:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00010000:00010000:1.0:1784756330.509731:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756331.151180:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489950336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756331.151277:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756331.151356:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950336 00000100:00100000:0.0:1784756331.151366:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950336 00000100:00100000:0.0:1784756331.151426:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756331.151436:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489950336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756331.151507:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756331.151556:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489950336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756331.151564:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1784756331.151584:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756331.151620:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fadf480 x1871452489950336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756331.151653:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489950336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756331.158849:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489950464:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.158917:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756331.158951:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489950976:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.158990:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756331.159014:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756331.159019:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489950592:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159043:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756331.159073:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950464 00000100:00100000:0.0:1784756331.159079:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950464 00000100:00100000:0.0:1784756331.159120:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784756331.159128:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489950464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159183:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489950464:12345-0@lo:400:kworker.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756331.159196:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784756331.159240:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950976 00000100:00100000:0.0:1784756331.159244:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950976 00000100:00100000:0.0:1784756331.159278:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784756331.159285:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489950976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159317:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489950976:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756331.159324:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784756331.159339:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950592 00000100:00100000:0.0:1784756331.159343:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950592 00000100:00100000:1.0:1784756331.159354:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489950464:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159364:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1784756331.159367:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641101500 x1871452489950976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756331.159370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489950592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756331.159379:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489950976:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159397:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489950592:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756331.159399:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489950592:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159404:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756331.159429:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489950720:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159455:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756331.159499:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756331.159505:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489950848:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159527:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784756331.159550:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756331.159559:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950720 00000100:00100000:0.0:1784756331.159562:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950720 00000100:00100000:0.0:1784756331.159586:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489950848 00000100:00100000:0.0:1784756331.159589:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489950848 00000100:00100000:0.0:1784756331.159603:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784756331.159608:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489950720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159650:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489950720:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756331.159657:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784756331.159669:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784756331.159674:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489950848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159697:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489950848:12345-0@lo:400:kworker.0 Request processed in 23us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756331.159702:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1784756331.159714:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756331.159728:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489950848:0@lo:400:kworker.0 00000100:00100000:0.0:1784756331.159736:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489950720:0@lo:400:kworker.0 00000001:02000400:3.0:1784756331.280070:0:10279:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:0.0:1784756331.535649:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756331.663613:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756331.663641:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489951104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756331.663717:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756331.663856:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951104 00000100:00100000:3.0:1784756331.663871:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951104 00000100:00100000:3.0:1784756331.664110:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784756331.664122:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489951104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756331.664159:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756331.664225:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489951104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756331.664233:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1784756331.664347:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73800 x1871452489951104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756331.664367:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489951104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756332.566015:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756332.913234:0:10327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 17:38:51 (1784756331) === 00010000:00010000:1.0:1784756333.585338:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756334.605577:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756334.668095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756334.668145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756334.668258:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800448 00000100:00100000:0.0:1784756334.668274:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800448 00000100:00100000:0.0:1784756334.668352:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1784756334.668360:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465800448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756334.668427:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465800448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756334.668433:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00080000:1.0:1784756334.668580:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756334.668643:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800320 00000100:00100000:2.0:1784756334.668646:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800320 00000100:00100000:2.0:1784756334.668684:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:2.0:1784756334.668692:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465800320:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784756334.668727:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465800320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756334.668731:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 207 00010000:00010000:0.0:1784756335.641855:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756336.271730:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756336.271754:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489951232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756336.271829:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756336.272058:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489951488:0@lo:400:kworker.0 00000100:00100000:0.0:1784756336.272089:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951232 00000100:00100000:3.0:1784756336.272096:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756336.272099:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951232 00000100:00100000:3.0:1784756336.272120:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756336.272128:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489951616:0@lo:400:kworker.0 00000100:00100000:3.0:1784756336.272157:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756336.272196:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784756336.272217:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756336.272226:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489951232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756336.272251:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951488 00000100:00100000:3.0:1784756336.272256:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951488 00002000:00000024:0.0:1784756336.272267:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756336.272295:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951616 00000100:00100000:3.0:1784756336.272300:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951616 00000100:00100000:0.0:1784756336.272318:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489951232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756336.272329:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784756336.272331:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756336.272341:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b76116d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756336.272369:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784756336.272378:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784756336.272387:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b76116d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871452489951488:12345-0@lo:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756336.272395:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756336.272415:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784756336.272423:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489951616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756336.272453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489951616:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756336.272460:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1784756336.272506:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756336.272847:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489951360:0@lo:400:kworker.0 00000100:00100000:2.0:1784756336.272884:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756336.272923:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489951872:0@lo:400:kworker.0 00000100:00100000:2.0:1784756336.272996:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784756336.273045:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102d80 x1871452489951232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756336.273063:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489951232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756336.273081:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756336.273087:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b76116dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489951744:0@lo:400:kworker.0 00000100:00100000:2.0:1784756336.273111:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756336.273138:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951872 00000100:00100000:2.0:1784756336.273142:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951872 00000100:00100000:0.0:1784756336.273181:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951360 00000100:00100000:0.0:1784756336.273187:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951360 00000100:00100000:2.0:1784756336.273194:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756336.273205:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756336.273223:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784756336.273233:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489951360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756336.273251:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489951872:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756336.273267:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784756336.273276:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489951360:12345-0@lo:400:kworker.0 Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756336.273284:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784756336.273307:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489951360:0@lo:400:kworker.0 00010000:00080000:2.0:1784756336.273320:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b76116d9f80 x1871452489951872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784756336.273327:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756336.273331:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489951872:0@lo:400:kworker.0 00000100:00100000:0.0:1784756336.273340:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489951744 00000100:00100000:0.0:1784756336.273345:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489951744 00000100:00100000:0.0:1784756336.273377:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784756336.273384:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489951744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756336.273431:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489951744:12345-0@lo:400:kworker.0 Request processed in 48us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756336.273439:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1784756336.273458:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756336.273555:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489951744:0@lo:400:kworker.0 00000100:00100000:3.0:1784756336.273684:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489951616:0@lo:400:kworker.0 00000100:00100000:3.0:1784756336.273696:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b76116dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871452489951488:0@lo:400:kworker.0 00010000:00010000:1.0:1784756336.653940:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756336.781803:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756336.781832:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489952000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756336.781920:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756336.782191:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952000 00000100:00100000:3.0:1784756336.782202:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952000 00000100:00100000:3.0:1784756336.782261:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784756336.782272:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489952000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756336.782318:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756336.782377:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489952000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756336.782385:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1784756336.782503:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e73b80 x1871452489952000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756336.782523:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489952000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756337.677592:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784756337.954826:0:10520:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1784756338.701679:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756339.727753:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756339.787520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756339.787926:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800576 00000100:00100000:0.0:1784756339.787947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800576 00000100:00100000:0.0:1784756339.788015:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:0.0:1784756339.788025:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465800576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756339.788107:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2356:x1871452465800576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 82us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756339.788115:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:3.0:1784756339.788123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756339.788174:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800704 00000100:00100000:0.0:1784756339.788179:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800704 00000100:00100000:0.0:1784756339.788225:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1784756339.788233:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465800704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756339.788277:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465800704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756339.788284:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00080000:0.0:1784756339.788302:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756340.751337:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756341.390089:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489952512:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390183:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390249:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784756341.390256:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489952128:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390286:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390310:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489952640:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390334:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390360:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489952384:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390380:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390396:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784756341.390401:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489952256:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390422:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390439:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489952768:0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390458:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756341.390503:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952512 00000100:00100000:3.0:1784756341.390509:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952512 00000100:00100000:3.0:1784756341.390557:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952768 00000100:00100000:3.0:1784756341.390561:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952768 00000100:00100000:3.0:1784756341.390580:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784756341.390588:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489952512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756341.390636:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489952512:12345-0@lo:400:kworker.0 Request processed in 48us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756341.390643:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784756341.391132:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784756341.391142:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489952768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391183:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489952768:12345-0@lo:400:kworker.0 Request processed in 44us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756341.391189:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784756341.391216:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952640 00000100:00100000:2.0:1784756341.391220:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952640 00000100:00100000:2.0:1784756341.391246:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952384 00000100:00100000:2.0:1784756341.391250:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952384 00000100:00100000:2.0:1784756341.391263:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952256 00000100:00100000:2.0:1784756341.391265:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952256 00000100:00100000:2.0:1784756341.391277:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756341.391283:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391313:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489952640:12345-0@lo:400:kworker.0 Request processed in 29us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756341.391319:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756341.391331:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756341.391337:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489952384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391369:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489952384:12345-0@lo:400:kworker.0 Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756341.391376:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756341.391388:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784756341.391394:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489952256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391418:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489952256:12345-0@lo:400:kworker.0 Request processed in 25us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756341.391424:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784756341.391446:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952128 00000100:00100000:2.0:1784756341.391450:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952128 00000100:00100000:2.0:1784756341.391489:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784756341.391495:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489952128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391523:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489952128:12345-0@lo:400:kworker.0 Request processed in 29us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756341.391529:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1784756341.391567:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784756341.391572:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756341.391574:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756341.391605:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489952128:0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.391621:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489952640:0@lo:400:kworker.0 00010000:00080000:2.0:1784756341.391634:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763fec1c00 x1871452489952512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756341.391644:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489952512:0@lo:400:kworker.0 00000100:00100000:1.0:1784756341.392827:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756341.392847:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489952896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756341.392904:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756341.392949:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489952896 00000100:00100000:1.0:1784756341.392955:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489952896 00000100:00100000:1.0:1784756341.392992:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756341.393000:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1871452489952896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756341.393034:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756341.393140:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1871452489952896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756341.393148:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1784756341.393185:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102d80 x1871452489952896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756341.393216:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489952896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756341.393548:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489952256:0@lo:400:kworker.0 00010000:00080000:2.0:1784756341.393573:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640eed880 x1871452489952768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756341.393581:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489952768:0@lo:400:kworker.0 00000100:00100000:2.0:1784756341.393593:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489952384:0@lo:400:kworker.0 00010000:00010000:1.0:1784756341.775396:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756341.902655:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756341.902677:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489953024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756341.902739:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756341.902875:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953024 00000100:00100000:1.0:1784756341.902883:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953024 00000100:00100000:1.0:1784756341.902937:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756341.902946:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489953024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756341.902989:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756341.903515:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489953024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 568us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756341.903523:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1784756341.906246:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e71180 x1871452489953024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756341.906281:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489953024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756342.798879:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756343.821716:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756344.845990:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756344.911547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756344.911608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756344.911654:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800960 00000100:00100000:2.0:1784756344.911665:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800960 00000100:00100000:2.0:1784756344.911731:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:2.0:1784756344.911743:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:2353:x1871452465800960:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756344.911775:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465800832 00000100:00100000:1.0:1784756344.911779:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465800832 00000100:00100000:1.0:1784756344.911820:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:2.0:1784756344.911825:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:2353:x1871452465800960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756344.911827:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465800832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784756344.911833:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00080000:2.0:1784756344.911854:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756344.911860:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465800832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756344.911867:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 211 00010000:00010000:1.0:1784756345.869677:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756346.509956:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756346.509979:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489953152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756346.510048:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756346.510182:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953152 00000100:00100000:1.0:1784756346.510191:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953152 00000100:00100000:1.0:1784756346.510256:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784756346.510267:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489953152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756346.510301:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756346.510349:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489953152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756346.510357:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1784756346.510395:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7641102d80 x1871452489953152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756346.510413:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489953152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784756346.510658:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756346.513380:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489953280:0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.513451:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756346.514168:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489953536:0@lo:400:kworker.0 00000100:00100000:0.0:1784756346.514202:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756346.514311:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953536 00000100:00100000:1.0:1784756346.514319:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953536 00000100:00100000:1.0:1784756346.514379:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784756346.514390:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489953536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756346.514452:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489953536:12345-0@lo:400:kworker.0 Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756346.514459:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1784756346.514508:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756346.514630:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489953792:0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.514661:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756346.514694:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756346.514714:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489953408:0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.514739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756346.514762:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489953664:0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.514770:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953280 00000100:00100000:2.0:1784756346.514773:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953280 00000100:00100000:3.0:1784756346.514791:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756346.514811:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784756346.514818:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489953280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756346.514820:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953408 00000100:00100000:3.0:1784756346.514823:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953408 00000100:00100000:3.0:1784756346.514840:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953664 00000100:00100000:3.0:1784756346.514843:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953664 00000100:00100000:3.0:1784756346.514861:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784756346.514866:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489953280:12345-0@lo:400:kworker.0 Request processed in 49us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756346.514867:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489953408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.514873:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784756346.514894:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489953408:12345-0@lo:400:kworker.0 Request processed in 28us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756346.514900:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784756346.514903:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784756346.514909:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489953664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756346.515057:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489953408:0@lo:400:kworker.0 00000100:00100000:3.0:1784756346.515068:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7641102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489953280:0@lo:400:kworker.0 00000100:00100000:2.0:1784756346.515084:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489953664:12345-0@lo:400:kworker.0 Request processed in 163us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756346.515091:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784756346.515112:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489953664:0@lo:400:kworker.0 00000100:00100000:1.0:1784756346.515182:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953792 00000100:00100000:1.0:1784756346.515186:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953792 00000100:00100000:1.0:1784756346.515224:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756346.515238:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489953792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756346.515280:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489953792:12345-0@lo:400:kworker.0 Request processed in 42us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756346.515286:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1784756346.515314:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784756346.515318:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784756346.515567:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c50700 x1871452489953792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756346.515578:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489953792:0@lo:400:kworker.0 00000100:00100000:0.0:1784756346.515688:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489953536:0@lo:400:kworker.0 00010000:00010000:3.0:1784756346.893642:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756347.021718:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756347.021750:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489953920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756347.021822:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756347.023805:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489953920 00000100:00100000:1.0:1784756347.023819:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489953920 00000100:00100000:0.0:1784756347.024175:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756347.024185:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489953920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756347.024223:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756347.024304:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489953920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756347.024311:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1784756347.024350:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e72680 x1871452489953920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756347.024382:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489953920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756347.919748:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756348.941767:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756349.965776:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756350.027975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756350.028033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756350.028193:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801088 00000100:00100000:1.0:1784756350.028204:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801088 00000100:00100000:1.0:1784756350.028259:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:1.0:1784756350.028269:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465801088:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756350.028351:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2354:x1871452465801088:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756350.028359:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:3.0:1784756350.028694:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801216 00000100:00100000:3.0:1784756350.028699:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801216 00000100:00100000:3.0:1784756350.028746:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:3.0:1784756350.028754:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465801216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784756350.028797:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465801216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 45us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756350.028804:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00080000:1.0:1784756350.029104:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756350.989691:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756351.629811:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489954304:0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630019:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489954048:0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630065:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756351.630112:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489954560:0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630140:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489954176:0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630172:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954048 00000100:00100000:3.0:1784756351.630189:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954048 00000100:00100000:3.0:1784756351.630237:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784756351.630245:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489954048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630292:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3319:x1871452489954048:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756351.630299:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1784756351.630511:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489954432:0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.630547:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756351.630647:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954432 00000100:00100000:3.0:1784756351.630652:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954432 00000100:00100000:3.0:1784756351.630698:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784756351.630704:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489954432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.630766:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489954432:12345-0@lo:400:kworker.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756351.630773:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1784756351.630827:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c50380 x1871452489954432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756351.630841:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489954432:0@lo:400:kworker.0 00000100:00080000:2.0:1784756351.631071:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756351.631133:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756351.631312:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954304 00000100:00100000:3.0:1784756351.631318:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954304 00000100:00100000:3.0:1784756351.631363:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756351.631370:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489954304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.631412:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871452489954304:12345-0@lo:400:kworker.0 Request processed in 42us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756351.631418:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756351.631438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756351.631458:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489954688:0@lo:400:kworker.0 00000100:00100000:3.0:1784756351.631639:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756351.631671:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954176 00000100:00100000:3.0:1784756351.631676:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954176 00000100:00100000:3.0:1784756351.631699:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784756351.631706:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489954176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784756351.631826:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756351.631870:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489954176:12345-0@lo:400:kworker.0 Request processed in 164us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756351.631877:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784756351.635838:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756351.636065:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489954048:0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.636118:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954560 00000100:00100000:2.0:1784756351.636125:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954560 00000100:00100000:2.0:1784756351.636182:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784756351.636191:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489954560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.636269:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871452489954560:12345-0@lo:400:kworker.0 Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756351.636276:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1784756351.636310:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756351.636337:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489954816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756351.636378:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756351.636410:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1871452489954304:0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.636435:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1871452489954560:0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.636501:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954688 00000100:00100000:2.0:1784756351.636506:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954688 00000100:00100000:2.0:1784756351.636534:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784756351.636541:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489954688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756351.636573:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489954688:12345-0@lo:400:kworker.0 Request processed in 33us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756351.636580:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784756351.636599:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756351.636629:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489954176:0@lo:400:kworker.0 00010000:00080000:2.0:1784756351.636645:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c51c00 x1871452489954688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756351.636656:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489954688:0@lo:400:kworker.0 00000100:00100000:1.0:1784756351.638556:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954816 00000100:00100000:1.0:1784756351.638568:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954816 00000100:00100000:1.0:1784756351.638623:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784756351.638633:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489954816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756351.639839:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756351.640007:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489954816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1373us (3624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756351.640018:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1784756351.640088:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c53100 x1871452489954816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756351.640122:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489954816:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1784756351.816572:0:11218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784756352.014079:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756352.142498:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489954944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756352.142583:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756352.142921:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489954944 00000100:00100000:0.0:1784756352.142930:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489954944 00000100:00100000:0.0:1784756352.142982:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756352.142992:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489954944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756352.143038:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756352.143100:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489954944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756352.143107:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1784756352.143226:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640e72300 x1871452489954944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756352.143246:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489954944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756353.037832:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756354.076219:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784756354.806299:0:11366:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb1017540 20000000:00000080:1.0:1784756354.806316:0:11366:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b763454ec00 uarg=0000000000000000 20000000:01000000:1.0:1784756354.806354:0:11366:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784756354.806361:0:11366:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784756354.806365:0:11366:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784756354.807383:0:11367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784756354.807647:0:11366:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784756354.814205:0:11366:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784756354.814238:0:11366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814260:0:11366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814268:0:11366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814274:0:11366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02400 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814280:0:11366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0240e expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814286:0:11366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814333:0:11366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814361:0:11366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 18 pid: 5787 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756354.814376:0:11366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955072:0@lo:104: 00000100:00100000:1.0:1784756354.814442:0:11366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756354.814592:0:11366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.814601:0:11366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756354.814610:0:11366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955200:0@lo:104: 00000100:00100000:1.0:1784756354.814644:0:11366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756354.816177:0:11366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.816191:0:11366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756354.816203:0:11366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955328:0@lo:104: 00000100:00100000:1.0:1784756354.816238:0:11366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756354.816258:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955072 00000100:00100000:0.0:1784756354.816265:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955072 00000100:00100000:0.0:1784756354.816305:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955200 00000100:00100000:0.0:1784756354.816308:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955200 00000100:00100000:0.0:1784756354.816322:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756354.816330:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:11366:x1871452489955072:12345-0@lo:104: 00010000:00010000:0.0:1784756354.816344:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816394:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756354.816400:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+4:11366:x1871452489955072:12345-0@lo:104: Request processed in 70us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756354.816407:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756354.816424:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784756354.816429:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:11366:x1871452489955200:12345-0@lo:104: 00010000:00010000:0.0:1784756354.816450:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816687:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784756354.816692:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:11366:x1871452489955200:12345-0@lo:104: Request processed in 263us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756354.816698:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784756354.816716:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784756354.816721:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816728:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609562000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1784756354.816733:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816741:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756354.816748:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756354.816753:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756354.816795:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816802:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756354.816824:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816831:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609562000/0x1782e2377f0240e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02415 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816850:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756354.816854:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816859:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609562a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1784756354.816862:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816869:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756354.816875:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756354.816879:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756354.816893:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816898:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756354.816904:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816911:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f02407 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.816920:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756354.816921:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756354.816923:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756354.816929:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756354.816954:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489955456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.816984:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756354.817018:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756354.817023:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489955584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.817045:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756354.817072:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955456 00000100:00100000:0.0:1784756354.817076:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955456 00010000:00010000:0.0:1784756354.817094:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.817174:0:11366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.817185:0:11366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 9 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756354.817195:0:11366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955712:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784756354.817248:0:11366:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b763fbfcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756354.817266:0:11366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955072:0@lo:104: 00000100:00100000:1.0:1784756354.817274:0:11366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e72680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955200:0@lo:104: 00000100:00100000:0.0:1784756354.817415:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955584 00000100:00100000:0.0:1784756354.817420:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955584 00010000:00010000:0.0:1784756354.817435:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 20 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756354.817449:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756354.817456:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3319:x1871452489955456:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784756354.817693:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784756354.817700:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1784756354.817715:0:5781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784756354.817723:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784756354.817729:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+20:3319:x1871452489955584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784756354.817737:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756354.817743:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 20 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.817752:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 20 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.817765:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7601679000/0x1782e2377f02407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f02400 expref: 20 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.817829:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756354.817835:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.817844:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.817854:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62e00/0x1782e2377f02415 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f0240e expref: 19 pid: 5787 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.817866:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756354.817900:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:3319:x1871452489955456:12345-0@lo:103:ldlm_bl.0 Request processed in 444us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756354.817917:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756354.818005:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489955456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.818029:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955328 00000100:00100000:0.0:1784756354.818033:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955328 00000100:00100000:0.0:1784756354.818051:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756354.818056:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fadf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:11366:x1871452489955328:12345-0@lo:104: 00010000:00010000:0.0:1784756354.818065:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818102:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756354.818108:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fadf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+3:11366:x1871452489955328:12345-0@lo:104: Request processed in 52us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756354.818114:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784756354.818126:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756354.818132:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818138:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63400 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1784756354.818141:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818148:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756354.818154:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756354.818165:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756354.818190:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818196:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756354.818213:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818219:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff8b7624f63400/0x1782e2377f023f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1782e2377f023f9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756354.818231:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756354.818232:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756354.818234:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756354.818244:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489955840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.818270:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756354.818276:0:11368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955840 00000100:00100000:3.0:1784756354.818280:0:11368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955840 00010000:00010000:3.0:1784756354.818294:0:11368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756354.818312:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784756354.818318:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:3321:x1871452489955840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.818322:0:11366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955328:0@lo:104: 00010000:00010000:3.0:1784756354.818325:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756354.818329:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.818338:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.818348:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62600/0x1782e2377f023f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1782e2377f023f2 expref: 18 pid: 5788 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.818356:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756354.818368:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756354.818391:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:3321:x1871452489955840:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756354.818398:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756354.818429:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489955840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.818545:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:3319:x1871452489955584:12345-0@lo:103:ldlm_bl.0 Request processed in 816us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756354.818553:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784756354.819055:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3319:1871452489955584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756354.822110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756354.822136:0:11366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11366:1871452489955712:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784756354.822171:0:11366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756354.823091:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801344 00000100:00100000:3.0:1784756354.823100:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801344 00010000:00010000:3.0:1784756354.823143:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756354.823232:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1784756354.823241:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465801344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756354.823256:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756354.823261:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823272:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823290:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7624f62200/0x1782e2377f023eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763e4 expref: 10 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823304:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823313:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823329:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823336:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823343:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823351:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823367:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7609563200 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:3.0:1784756354.823371:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823380:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823404:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756354.823414:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756354.824981:0:11366:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.825005:0:11366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756354.825025:0:11366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7609563200/0x1782e2377f0241c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756354.825796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88574ee4-5a0b-461a-86e7-71d74919f81d+9:2355:x1871452465801344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2549us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756354.825808:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00010000:00010000:0.0:1784756355.085704:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756355.149288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756355.149452:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801472 00000100:00100000:0.0:1784756355.149462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801472 00000100:00100000:0.0:1784756355.149610:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:0.0:1784756355.149628:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465801472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:2.0:1784756355.149675:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756355.149709:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465801472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756355.149732:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:3.0:1784756355.917748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756355.917879:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801600 00000100:00100000:0.0:1784756355.917889:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801600 00000100:00100000:0.0:1784756355.917945:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:0.0:1784756355.917955:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+9:5569:x1871452465801600:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756355.917971:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756355.918000:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6b200/0x1782e2377f02423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763eb expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756355.918027:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6b200/0x1782e2377f02423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763eb expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756355.918040:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6b200/0x1782e2377f02423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763eb expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756355.918049:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6b200, rc 0) 00000100:00100000:0.0:1784756355.918108:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465801600:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 155us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756355.918114:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:3.0:1784756355.925166:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756355.925245:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801728 00000100:00100000:0.0:1784756355.925256:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801728 00000100:00100000:0.0:1784756355.925314:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:0.0:1784756355.925325:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465801728:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756355.925609:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465801728:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 285us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756355.925618:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:0.0:1784756355.928369:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756355.928438:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801856 00000100:00100000:3.0:1784756355.928447:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801856 00000100:00100000:3.0:1784756355.928575:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:3.0:1784756355.928585:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465801856:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756355.928783:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88574ee4-5a0b-461a-86e7-71d74919f81d+10:5569:x1871452465801856:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 199us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756355.928792:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00010000:00010000:0.0:1784756356.112273:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784756356.559658:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756356.559665:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b7637cbf000 from 7 10000000:01000000:2.0:1784756356.559670:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756356.559775:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756356.559788:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756356.559811:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756356.559838:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763b8aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489955968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756356.559911:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756356.559961:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7637d5a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784756356.560050:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489955968 00000100:00100000:1.0:1784756356.560057:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489955968 00000100:00100000:1.0:1784756356.560110:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784756356.560120:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+16:5792:x1871452489955968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756356.560131:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756356.560143:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609563200/0x1782e2377f02431 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f0242a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.560164:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609563200/0x1782e2377f02431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f0242a expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.560174:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609563200/0x1782e2377f02431 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f0242a expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.560183:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609563200, rc 0) 00000100:00100000:1.0:1784756356.560222:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489955968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756356.560228:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784756356.560269:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763b8aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489955968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756356.560283:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02431 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.560292:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f02431 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756356.560363:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.560389:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756356.560403:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7630c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1784756356.560415:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956096 00000100:00100000:1.0:1784756356.560419:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956096 00000100:00100000:1.0:1784756356.560439:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784756356.560446:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489956096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.560832:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489956096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756356.560839:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784756356.560870:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.560897:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.560929:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756356.560940:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7630c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1784756356.560950:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956224 00000100:00100000:1.0:1784756356.560953:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956224 00000100:00100000:1.0:1784756356.560974:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784756356.560994:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489956224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.561127:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489956224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756356.561133:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784756356.561168:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784756356.565004:0:11482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784756356.571386:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784756356.571422:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756356.571434:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02431 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.571447:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7624f62800/0x1782e2377f0242a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f02431 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756356.571458:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784756356.571460:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b760fc26000 from 7 10000000:01000000:1.0:1784756356.571463:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756356.571530:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.571539:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.571550:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756356.571585:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.571646:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756356.571682:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7630c21300 going to sleep for 11 seconds 00000100:00100000:0.0:1784756356.572669:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956352 00000100:00100000:0.0:1784756356.572679:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956352 00000100:00100000:0.0:1784756356.572741:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784756356.572749:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+17:5792:x1871452489956352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756356.572764:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756356.572779:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7640e6a800/0x1782e2377f0243f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02438 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756356.572804:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7640e6a800/0x1782e2377f0243f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02438 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756356.572815:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7640e6a800/0x1782e2377f0243f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02438 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756356.572825:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a800, rc 0) 00000100:00100000:0.0:1784756356.572875:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.572882:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784756356.572945:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7634736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756356.572962:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0243f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756356.572971:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0243f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756356.573044:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756356.573080:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.573104:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7633cfc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756356.573194:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956480 00000100:00100000:0.0:1784756356.573198:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956480 00000100:00100000:0.0:1784756356.573220:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784756356.573226:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756356.573439:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.573446:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784756356.573495:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756356.573523:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756356.573557:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.574672:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7633cfc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756356.574751:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956608 00000100:00100000:0.0:1784756356.574758:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956608 00000100:00100000:0.0:1784756356.574788:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784756356.574796:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756356.574960:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.574966:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784756356.575027:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784756356.577076:0:11486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784756356.577277:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784756356.577295:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784756356.577306:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0243f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756356.577327:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7609562a00/0x1782e2377f02438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0243f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756356.577337:0:5792:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784756356.577340:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8b761808f800 from 7 10000000:01000000:3.0:1784756356.577343:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784756356.577375:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756356.577383:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756356.577392:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756356.577415:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756356.577495:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756356.577527:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7605ff6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756356.577581:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956736 00000100:00100000:1.0:1784756356.577587:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956736 00000100:00100000:1.0:1784756356.577630:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784756356.577638:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+18:5792:x1871452489956736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756356.577650:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756356.577662:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7609562000/0x1782e2377f0244d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1782e2377f02446 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.577786:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7609562000/0x1782e2377f0244d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1782e2377f02446 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.577798:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7609562000/0x1782e2377f0244d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1782e2377f02446 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756356.577805:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7609562000, rc 0) 00000100:00100000:1.0:1784756356.577846:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489956736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756356.577852:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784756356.577916:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756356.577929:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0244d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756356.577939:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1782e2377f0244d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756356.578012:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756356.578035:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756356.578060:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7605ff6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784756356.578096:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956864 00000100:00100000:1.0:1784756356.578101:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956864 00000100:00100000:1.0:1784756356.578371:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784756356.578379:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489956864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756356.578593:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489956864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756356.578600:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784756356.578765:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756356.578790:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756356.578823:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756356.578850:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7605ff6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756356.578884:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489956992 00000100:00100000:2.0:1784756356.578887:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489956992 00000100:00100000:2.0:1784756356.578913:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784756356.578919:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489956992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756356.579061:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:5792:x1871452489956992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756356.579067:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784756356.579132:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c73f41-e9a1-4359-8051-7c5e1edb844a:5792:1871452489956992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756356.583440:0:11487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784756356.583624:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784756356.583643:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756356.583654:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0244d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756356.583666:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff8b7601679800/0x1782e2377f02446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1782e2377f0244d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756356.749649:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489957120:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.749732:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.749779:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489957632:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.749814:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.749846:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756356.749851:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489957504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.749870:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.749894:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489957248:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.749913:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.749927:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756356.749932:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489957376:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.749948:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.749973:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957632 00000100:00100000:0.0:1784756356.749992:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957632 00000100:00100000:0.0:1784756356.750043:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957376 00000100:00100000:0.0:1784756356.750047:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957376 00000100:00100000:0.0:1784756356.750071:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756356.750079:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489957632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750130:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489957632:12345-0@lo:400:kworker.0 Request processed in 52us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.750137:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756356.750151:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756356.750157:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489957376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750182:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489957376:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.750188:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756356.750202:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957120 00000100:00100000:0.0:1784756356.750204:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957120 00000100:00100000:0.0:1784756356.750222:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957504 00000100:00100000:0.0:1784756356.750224:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957504 00000100:00100000:0.0:1784756356.750240:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957248 00000100:00100000:0.0:1784756356.750242:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957248 00000100:00100000:0.0:1784756356.750253:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784756356.750258:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489957120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750287:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489957120:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.750293:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784756356.750302:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784756356.750307:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489957504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750326:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489957504:12345-0@lo:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.750332:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784756356.750339:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784756356.750344:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489957248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750366:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871452489957248:12345-0@lo:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.750372:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784756356.750393:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756356.750397:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756356.750399:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756356.750431:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c50e00 x1871452489957376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756356.750446:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489957376:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750457:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1871452489957248:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750504:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489957504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.750521:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489957120:0@lo:400:kworker.0 00010000:00080000:0.0:1784756356.750529:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c51c00 x1871452489957632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756356.750537:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489957632:0@lo:400:kworker.0 00000100:00100000:0.0:1784756356.756133:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756356.756153:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489957760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756356.756216:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756356.756268:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957760 00000100:00100000:0.0:1784756356.756276:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957760 00000100:00100000:0.0:1784756356.756321:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756356.756328:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489957760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756356.756362:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756356.756401:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489957760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756356.756408:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784756356.756441:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7610c51c00 x1871452489957760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756356.756458:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7610c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489957760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756357.133829:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756357.261825:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489957888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756357.261907:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756357.262271:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489957888 00000100:00100000:2.0:1784756357.262278:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489957888 00000100:00100000:2.0:1784756357.262331:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784756357.262354:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763b8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489957888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756357.262389:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756357.262515:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763b8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489957888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756357.262524:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1784756357.263032:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7640eef800 x1871452489957888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756357.263052:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489957888:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1784756358.005217:0:11564:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784756358.158230:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756359.183220:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756360.205788:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756360.296823:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756360.296871:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802112 00000100:00100000:0.0:1784756360.296880:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802112 00000100:00100000:0.0:1784756360.296943:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1784756360.296972:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465802112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756360.297064:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2355:x1871452465802112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756360.297073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00080000:0.0:1784756360.297098:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756360.297139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756360.299647:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465801984 00000100:00100000:1.0:1784756360.299721:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465801984 00000100:00100000:1.0:1784756360.299826:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:1.0:1784756360.299965:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465801984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756360.300047:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465801984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 87us (2907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756360.300055:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 227 00000001:02000400:1.0:1784756360.975432:0:11664:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 17:39:19 (1784756359) === 00000100:00100000:3.0:1784756361.045822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.045958:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802240 00000100:00100000:0.0:1784756361.045967:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802240 00000100:00100000:0.0:1784756361.046030:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1784756361.046040:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802240:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1784756361.046060:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756361.046109:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763f2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046174:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046201:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046214:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046229:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046236:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046242:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046903:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046913:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046919:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046925:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6aa00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756361.046930:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046937:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046961:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:0.0:1784756361.046965:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756361.046970:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046977:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f0245b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046989:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.046995:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047001:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047012:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6b000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756361.047016:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047022:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047030:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff8b7603c80800) 00010000:00010000:0.0:1784756361.047032:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756361.047035:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047040:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02462 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047076:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02454 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763f2 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047086:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:0.0:1784756361.047089:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756361.047093:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763f2 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.047103:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6be00, rc 0) 00000100:00100000:0.0:1784756361.047515:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802240:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1475us (1700us total) trans 0 rc 301/301 00000100:00100000:0.0:1784756361.047522:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1784756361.053444:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.053504:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802368 00000100:00100000:2.0:1784756361.053515:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802368 00000100:00100000:2.0:1784756361.053575:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1784756361.053585:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802368:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1784756361.053606:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.054000:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a763f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054070:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054085:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054096:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054110:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054118:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054125:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054383:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054392:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054398:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054404:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.054408:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054416:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054428:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.054431:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.054436:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054442:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f02470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054454:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054460:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054529:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054541:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.054544:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054550:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054558:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff8b76107ed800) 00010000:00010000:2.0:1784756361.054560:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.054563:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054568:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054603:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02469 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763f9 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.054613:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.054616:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784756361.055008:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763f9 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.055022:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63000, rc 0) 00000100:00100000:2.0:1784756361.055130:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802368:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1545us (1693us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756361.055139:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1784756361.060354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.060458:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802496 00000100:00100000:0.0:1784756361.060489:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802496 00000100:00100000:0.0:1784756361.060534:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1784756361.060545:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802496:12345-192.168.202.4@tcp:37:bash.0 00000100:00100000:2.0:1784756361.066411:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:7609:x1871452465802496:12345-192.168.202.4@tcp:37:bash.0 Request processed in 5858us (6059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.066439:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1784756361.077432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.077592:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802624 00000100:00100000:2.0:1784756361.077602:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802624 00000100:00100000:2.0:1784756361.077665:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1784756361.077675:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:10398:x1871452465802624:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1784756361.077695:0:10483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.077716:0:10483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f0247e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76400 expref: -99 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077782:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077797:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077808:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077853:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077862:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.077869:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078141:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078160:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078167:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078173:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.078178:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078185:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078198:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.078201:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.078205:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078212:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f02485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078223:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078230:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078236:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078241:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.078250:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078256:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078264:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff8b76107ed800) 00010000:00010000:2.0:1784756361.078267:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.078270:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078276:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0248c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078308:0:10483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f0247e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76400 expref: 7 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078320:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.078322:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.078325:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f0247e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76400 expref: 7 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.078334:0:10483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63000, rc 0) 00000100:00100000:2.0:1784756361.078398:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:10398:x1871452465802624:12345-192.168.202.4@tcp:101:rm.0 Request processed in 724us (976us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756361.078406:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1784756361.145247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756361.145344:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802752 00000100:00100000:1.0:1784756361.145361:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802752 00000100:00100000:1.0:1784756361.145423:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1784756361.145433:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465802752:12345-192.168.202.4@tcp:41:mkdir.0 00000004:00000024:1.0:1784756361.145512:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784756361.145594:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465802752:12345-192.168.202.4@tcp:41:mkdir.0 Request processed in 162us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756361.145601:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784756361.146912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.146983:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465802880 00000100:00100000:2.0:1784756361.146990:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465802880 00000100:00100000:2.0:1784756361.147035:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1784756361.147045:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bab229c-803d-40e3-a820-b17a4715ff86+6:10401:x1871452465802880:12345-192.168.202.4@tcp:700:mkdir.0 00000100:00100000:2.0:1784756361.147138:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bab229c-803d-40e3-a820-b17a4715ff86+6:10401:x1871452465802880:12345-192.168.202.4@tcp:700:mkdir.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.147144:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1784756361.148800:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.148841:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465803136 00000100:00100000:2.0:1784756361.148849:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465803136 00000100:00100000:2.0:1784756361.148891:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:2.0:1784756361.148900:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:10401:x1871452465803136:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:2.0:1784756361.148961:0:10483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756361.148985:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f02366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a763cf expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.148999:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.149006:0:10483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756361.149237:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.149250:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.149261:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.149318:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.149327:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.149334:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.150635:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784756361.150924:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150935:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150951:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150957:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.150961:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150969:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150983:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed800) 00010000:00010000:2.0:1784756361.150987:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.150991:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.150997:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f02493 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756361.151014:0:10483:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005be36475 reply state 00000000c0d610db transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756361.151024:0:10483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784756361.151169:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+7:10401:x1871452465803136:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 2265us (2372us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784756361.151187:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00010000:00010000:3.0:1784756361.153419:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153435:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153442:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153448:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1784756361.153453:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153616:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153828:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b76107ed700) 00010000:00010000:3.0:1784756361.153831:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756361.153835:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.153842:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63e00/0x1782e2377f0249a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756361.164021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.164123:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465803264 00000100:00100000:0.0:1784756361.164132:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465803264 00000100:00100000:0.0:1784756361.164184:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1784756361.164199:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:10402:x1871452465803264:12345-192.168.202.4@tcp:101:chmod.0 00010000:00010000:0.0:1784756361.164221:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756361.164244:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f024a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76407 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164789:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164806:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164817:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.164878:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756361.164881:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.164921:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164962:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f024a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76407 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164983:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76407 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.164992:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:2.0:1784756361.164995:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756361.164997:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63000, rc 0) 00000100:00100000:2.0:1784756361.165086:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:10402:x1871452465803264:12345-192.168.202.4@tcp:101:chmod.0 Request processed in 887us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.165094:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1784756361.168232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756361.168821:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465803520 00000100:00100000:3.0:1784756361.168832:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465803520 00000100:00100000:2.0:1784756361.168975:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1784756361.168987:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:10402:x1871452465803520:12345-192.168.202.4@tcp:36:chmod.0 00010000:00010000:2.0:1784756361.169056:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756361.169133:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76407 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.169149:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:2.0:1784756361.169161:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756361.169197:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.169209:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.169283:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756361.170160:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf8157d2 reply state 000000001e194a13 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756361.170169:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784756361.170296:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1784756361.170393:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+8:10402:x1871452465803520:12345-192.168.202.4@tcp:36:chmod.0 Request processed in 1406us (2167us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784756361.170401:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00010000:00010000:1.0:1784756361.172639:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172657:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172665:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172671:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1784756361.172676:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172684:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172705:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed800) 00010000:00010000:1.0:1784756361.172708:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784756361.172713:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.172719:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63800/0x1782e2377f024af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756361.188923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.189073:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465803648 00000100:00100000:2.0:1784756361.189084:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465803648 00000100:00100000:2.0:1784756361.189149:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784756361.189160:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+7:10403:x1871452465803648:12345-192.168.202.4@tcp:101:chown.0 00010000:00010000:2.0:1784756361.189183:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.189206:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7640e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.189354:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.189367:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.189378:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.189438:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756361.189442:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.190043:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.190068:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7640e expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.190084:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7640e expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.190093:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.190096:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756361.190099:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62a00, rc 0) 00000100:00100000:2.0:1784756361.190160:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+8:10403:x1871452465803648:12345-192.168.202.4@tcp:101:chown.0 Request processed in 1002us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.190168:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1784756361.193130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.193303:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465803776 00000100:00100000:2.0:1784756361.193314:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465803776 00000100:00100000:2.0:1784756361.193428:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:2.0:1784756361.193439:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+8:10403:x1871452465803776:12345-192.168.202.4@tcp:101:chown.0 00010000:00010000:2.0:1784756361.193460:0:10483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.193503:0:10483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76415 expref: -99 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193584:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193598:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193609:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193638:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193650:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193657:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193756:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193764:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193782:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.193834:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784756361.193839:0:10483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.193859:0:10483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193872:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193878:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193885:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193892:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.193896:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193903:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193915:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.193918:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.193922:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193928:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f024cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193953:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193969:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193975:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193980:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.193983:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193988:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.193996:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.193998:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.194001:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.194007:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.194043:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76415 expref: 10 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.194056:0:10483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76415 expref: 9 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.194063:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107ed500) 00010000:00010000:2.0:1784756361.194065:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756361.194077:0:10483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62200, rc 0) 00000100:00100000:2.0:1784756361.194143:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+9:10403:x1871452465803776:12345-192.168.202.4@tcp:101:chown.0 Request processed in 706us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.194150:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:1.0:1784756361.198143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.198228:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804032 00000100:00100000:2.0:1784756361.198238:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804032 00000100:00100000:2.0:1784756361.198302:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:2.0:1784756361.198312:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+9:10403:x1871452465804032:12345-192.168.202.4@tcp:36:chown.0 00010000:00010000:2.0:1784756361.198368:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756361.198406:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76415 expref: 9 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.198425:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107ed500) 00010000:00010000:2.0:1784756361.198436:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756361.198462:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.198515:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.198650:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.229770:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784756361.244247:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1784756361.244323:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007253eef8 reply state 00000000d1137bf3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756361.244337:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784756361.244551:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1784756361.244737:0:5795:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784756361.244757:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:10403:x1871452465804032:12345-192.168.202.4@tcp:36:chown.0 Request processed in 46443us (46620us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784756361.244767:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00010000:00010000:1.0:1784756361.244780:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244790:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244797:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244803:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1784756361.244807:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244815:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244829:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edc00) 00010000:00010000:1.0:1784756361.244833:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784756361.244837:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.244842:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63000/0x1782e2377f024e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756361.259038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.259144:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804160 00000100:00100000:0.0:1784756361.259154:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804160 00000100:00100000:0.0:1784756361.259214:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1784756361.259226:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:10404:x1871452465804160:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:0.0:1784756361.259251:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756361.259271:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f024e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7641c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784756361.260905:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1578us 00010000:00010000:2.0:1784756361.272280:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.272313:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.272332:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.272346:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.272353:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.272359:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273053:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273064:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273073:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.273160:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756361.273164:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.273553:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273568:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273575:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273592:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273599:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.273603:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273611:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273624:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:2.0:1784756361.273627:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.273632:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273638:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f024ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273715:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273722:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273727:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273732:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.273735:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273751:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273759:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b76107ed500) 00010000:00010000:2.0:1784756361.273762:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.273764:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273770:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f024f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273809:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f024e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7641c expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273826:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7641c expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.273833:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.273835:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784756361.273837:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63600, rc 0) 00000100:00100000:2.0:1784756361.273971:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:10404:x1871452465804160:12345-192.168.202.4@tcp:101:touch.500 Request processed in 14746us (14941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.273981:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1784756361.278137:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.278223:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804416 00000100:00100000:2.0:1784756361.278234:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804416 00000100:00100000:2.0:1784756361.278310:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1784756361.278320:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+7:10404:x1871452465804416:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:2.0:1784756361.278343:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.278378:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02503 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76423 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278744:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278759:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278770:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278782:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278789:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.278796:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784756361.279535:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1784756361.279764:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279776:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279785:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279813:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279829:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279836:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279841:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.279846:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279853:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279864:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.279867:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.279871:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279877:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0250a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756361.279889:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061e4de5a reply state 00000000d26c96d0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756361.279897:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784756361.279924:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02503 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76423 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279950:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76423 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.279968:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b76107edc00) 00010000:00010000:2.0:1784756361.279971:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784756361.279973:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62e00, rc 0) 00000100:00100000:2.0:1784756361.280037:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+10:10404:x1871452465804416:12345-192.168.202.4@tcp:101:touch.500 Request processed in 1719us (1911us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756361.280044:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00010000:00010000:1.0:1784756361.286676:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286696:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286724:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286731:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1784756361.286736:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286744:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286762:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8b76107edf00) 00010000:00010000:1.0:1784756361.286765:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756361.286770:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.286776:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02511 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756361.290331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.290416:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804672 00000100:00100000:2.0:1784756361.290428:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804672 00000100:00100000:2.0:1784756361.290523:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:2.0:1784756361.290531:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7610c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+9:10404:x1871452465804672:12345-192.168.202.4@tcp:36:touch.500 00010000:00010000:2.0:1784756361.290591:0:10483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756361.290618:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76423 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.290638:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b76107edc00) 00010000:00010000:2.0:1784756361.290657:0:10483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756361.290706:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.290719:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.290729:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756361.290875:0:10483:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c852893 reply state 00000000464f713d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756361.290905:0:10483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784756361.291003:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7610c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+10:10404:x1871452465804672:12345-192.168.202.4@tcp:36:touch.500 Request processed in 472us (680us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784756361.291010:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00010000:00010000:1.0:1784756361.292809:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292825:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292832:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292837:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1784756361.292841:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292861:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292876:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b76107ed500) 00010000:00010000:1.0:1784756361.292880:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756361.292884:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756361.292891:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f02526 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756361.302988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.303892:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804800 00000100:00100000:2.0:1784756361.303905:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804800 00000100:00100000:3.0:1784756361.305180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784756361.305200:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+9:10404:x1871452465804800:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:3.0:1784756361.305225:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756361.305262:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f0252d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7642a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.305841:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f0252d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7642a expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.305857:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f0252d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7642a expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.305876:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b7605173e00) 00010000:00010000:3.0:1784756361.305879:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784756361.305883:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601678a00, rc 0) 00000100:00100000:3.0:1784756361.305961:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+10:10404:x1871452465804800:12345-192.168.202.4@tcp:101:touch.500 Request processed in 771us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756361.305968:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784756361.312360:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.312968:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465804928 00000100:00100000:0.0:1784756361.312980:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465804928 00000100:00100000:0.0:1784756361.313032:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1784756361.313039:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7641102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1871452465804928:12345-192.168.202.4@tcp:8:touch.500 00010000:00080000:0.0:1784756361.313068:0:6601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8bab229c-803d-40e3-a820-b17a4715ff86@192.168.202.4@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1784756361.313093:0:6601:0:(genops.c:1406:class_connect()) connect: client 8bab229c-803d-40e3-a820-b17a4715ff86, cookie 0x1782e2377f02534 00002000:00100000:0.0:1784756361.313104:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bab229c-803d-40e3-a820-b17a4715ff86/ffff8b7637d12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784756361.313124:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784756361.313406:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784756361.313435:0:6601:0:(import.c:65:import_set_state_nolock()) ffff8b7637d13800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784756361.314212:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7641102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2352:x1871452465804928:12345-192.168.202.4@tcp:8:touch.500 Request processed in 1168us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756361.314220:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1784756361.319749:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.319903:0:6910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465805056 00000100:00100000:0.0:1784756361.319914:0:6910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465805056 00000100:00100000:0.0:1784756361.320006:0:6910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1784756361.320017:0:6910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:0:x1871452465805056:12345-192.168.202.4@tcp:2:touch.500 00000100:00080000:2.0:1784756361.320515:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1784756361.365725:0:7515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1784756361.365744:0:7515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00000100:00100000:2.0:1784756361.366434:0:6910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bab229c-803d-40e3-a820-b17a4715ff86+5:0:x1871452465805056:12345-192.168.202.4@tcp:2:touch.500 Request processed in 46412us (46689us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784756361.366446:0:6910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1784756361.372586:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756361.372693:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465805312 00000100:00100000:3.0:1784756361.372704:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465805312 00000100:00100000:3.0:1784756361.372850:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1784756361.372862:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7633c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+10:10404:x1871452465805312:12345-192.168.202.4@tcp:35:touch.500 00000100:00100000:3.0:1784756361.373227:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7633c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+11:10404:x1871452465805312:12345-192.168.202.4@tcp:35:touch.500 Request processed in 365us (650us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784756361.373235:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1784756361.393749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.393934:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465805440 00000100:00100000:2.0:1784756361.393952:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465805440 00000100:00100000:2.0:1784756361.394015:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1784756361.394025:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+11:10405:x1871452465805440:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1784756361.394048:0:10483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.394068:0:10483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f0253b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76431 expref: -99 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394134:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394149:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394160:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.394225:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756361.394236:0:10483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.394414:0:10483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394443:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f0253b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76431 expref: 13 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394459:0:10483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76431 expref: 12 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.394716:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.394719:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756361.394723:0:10483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63c00, rc 0) 00000100:00100000:2.0:1784756361.394828:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+12:10405:x1871452465805440:12345-192.168.202.4@tcp:101:rm.0 Request processed in 803us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.394837:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1784756361.406185:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.406332:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465805696 00000100:00100000:0.0:1784756361.406342:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465805696 00000100:00100000:0.0:1784756361.406414:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1784756361.406424:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+12:10405:x1871452465805696:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1784756361.406445:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756361.406464:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f02549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76438 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756361.406711:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784756361.406891:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f02549 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76438 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.406919:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:0.0:1784756361.406922:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756361.406927:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f02549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76438 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.406952:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6ba00, rc 0) 00000100:00100000:0.0:1784756361.407009:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+13:10405:x1871452465805696:12345-192.168.202.4@tcp:101:rm.0 Request processed in 586us (833us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1784756361.407016:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1784756361.413229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.413311:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465805824 00000100:00100000:2.0:1784756361.413322:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465805824 00000100:00100000:2.0:1784756361.413379:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1784756361.413390:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+13:10405:x1871452465805824:12345-192.168.202.4@tcp:37:rm.0 00000100:00100000:2.0:1784756361.418156:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+13:10405:x1871452465805824:12345-192.168.202.4@tcp:37:rm.0 Request processed in 4756us (4924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.418171:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1784756361.429895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756361.430015:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465806080 00000100:00100000:3.0:1784756361.430024:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465806080 00000100:00100000:3.0:1784756361.430071:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1784756361.430081:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608615050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+13:10405:x1871452465806080:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:3.0:1784756361.430341:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608615050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+14:10405:x1871452465806080:12345-192.168.202.4@tcp:35:rm.0 Request processed in 260us (454us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784756361.430349:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1784756361.433899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.434004:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465806336 00000100:00100000:2.0:1784756361.434016:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465806336 00000100:00100000:2.0:1784756361.434081:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1784756361.434091:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+14:10405:x1871452465806336:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1784756361.434115:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.434149:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7643f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.434274:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0255e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.434288:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0255e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.434300:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0255e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.434313:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784756361.434443:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f02557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7643f expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.434503:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0255e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7643f expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.434513:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.434515:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784756361.434519:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f62600, rc 0) 00000100:00100000:2.0:1784756361.434579:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7608084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465806336:12345-192.168.202.4@tcp:101:rm.0 Request processed in 490us (688us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784756361.434587:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:1.0:1784756361.438892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.438989:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465806464 00000100:00100000:0.0:1784756361.438999:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465806464 00000100:00100000:0.0:1784756361.439060:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:0.0:1784756361.439070:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465806464:12345-192.168.202.4@tcp:41:rm.0 00000004:00000024:0.0:1784756361.439132:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784756361.439205:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465806464:12345-192.168.202.4@tcp:41:rm.0 Request processed in 136us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756361.439212:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:1.0:1784756361.444888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.445013:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465806592 00000100:00100000:2.0:1784756361.445022:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465806592 00000100:00100000:2.0:1784756361.445076:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:2.0:1784756361.445086:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465806592:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1784756361.445122:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756361.445143:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f0256c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76446 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445204:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445218:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445229:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445246:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445254:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445260:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445367:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445375:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445382:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756361.445407:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784756361.445417:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756361.445438:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445452:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445461:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445515:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445523:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445528:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.445532:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445540:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445552:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:2.0:1784756361.445555:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.445559:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445565:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62200/0x1782e2377f02573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445577:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445594:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445600:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445605:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1784756361.445608:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445614:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445632:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8b76107ed800) 00010000:00010000:2.0:1784756361.445635:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756361.445638:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445948:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62c00/0x1782e2377f0257a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.445987:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62e00/0x1782e2377f0256c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76446 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.446001:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76446 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.446009:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b7605173e00) 00010000:00010000:2.0:1784756361.446011:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784756361.446020:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7624f63400, rc 0) 00000100:00100000:2.0:1784756361.446091:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bab229c-803d-40e3-a820-b17a4715ff86+17:10405:x1871452465806592:12345-192.168.202.4@tcp:101:rm.0 Request processed in 1005us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756361.446099:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1784756361.450186:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756361.450278:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465806848 00000100:00100000:0.0:1784756361.450288:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465806848 00000100:00100000:0.0:1784756361.450349:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1784756361.450359:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+17:10405:x1871452465806848:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:0.0:1784756361.450406:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784756361.450429:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63400/0x1782e2377f02581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76446 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450457:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f0252d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7642a expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450511:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b7605173e00) 00010000:00010000:0.0:1784756361.450528:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63c00/0x1782e2377f02542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76431 expref: 15 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450537:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:0.0:1784756361.450541:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756361.450561:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450573:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450582:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450598:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450604:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450609:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450797:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450812:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.450816:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784756361.451487:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1784756361.451498:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 269373030000ns, next at 270373027486ns, rc = 0 00010000:00010000:0.0:1784756361.451553:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451563:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451570:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451577:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451583:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451588:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451610:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784756361.451626:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451632:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.451858:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756361.451864:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.451952:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.452014:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6b400 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756361.452020:0:6614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.452028:0:6614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.452040:0:6614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b7603c80b00) 00010000:00010000:2.0:1784756361.452043:0:6614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784756361.452047:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.452052:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f0259d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756361.452063:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756361.452065:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756361.452067:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756361.452088:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756361.452093:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452100:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452108:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b7603c80b00) 00010000:00010000:0.0:1784756361.452110:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784756361.452113:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452119:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f02596 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452139:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452145:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452152:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452157:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6a400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756361.452160:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452177:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452185:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:0.0:1784756361.452188:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756361.452190:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.452195:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02588 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756361.452203:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dce139e5 reply state 00000000388c3d39 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756361.452210:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756361.452346:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465806848:12345-192.168.202.4@tcp:36:rm.0 Request processed in 1986us (2165us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784756361.452355:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00010000:3.0:1784756361.455900:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455918:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455925:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455930:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6ba00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1784756361.455945:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455953:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455969:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff8b7603c80800) 00010000:00010000:3.0:1784756361.455972:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756361.455976:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.455983:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0258f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756361.457713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756361.458162:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807104 00000100:00100000:2.0:1784756361.458173:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807104 00000100:00100000:2.0:1784756361.458238:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1784756361.458249:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+15:10405:x1871452465807104:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:2.0:1784756361.458725:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7634736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465807104:12345-192.168.202.4@tcp:35:rm.0 Request processed in 477us (1019us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784756361.458741:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1784756361.463058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756361.463148:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807360 00000100:00100000:3.0:1784756361.463157:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807360 00000100:00100000:3.0:1784756361.463243:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1784756361.463255:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+16:10405:x1871452465807360:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1784756361.463325:0:10483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784756361.463351:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62600/0x1782e2377f0255e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7643f expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463374:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f63600/0x1782e2377f024fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7641c expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463384:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b76107edd00) 00010000:00010000:3.0:1784756361.463400:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7624f62a00/0x1782e2377f024bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7640e expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463409:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b76107ed000) 00010000:00010000:3.0:1784756361.463415:0:10483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756361.463441:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463453:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463462:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463518:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463526:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.463532:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464063:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464073:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464080:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756361.464924:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784756361.464951:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464958:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464965:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464971:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7601678a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1784756361.464975:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464983:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.464994:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b7605173400) 00010000:00010000:3.0:1784756361.464997:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784756361.465001:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465016:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465038:0:10483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465045:0:10483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465051:0:10483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465056:0:10483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7601678c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1784756361.465059:0:10483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465065:0:10483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465073:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7605173000) 00010000:00010000:3.0:1784756361.465075:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756361.465078:0:10483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756361.465084:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784756361.465093:0:10483:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050289f13 reply state 000000006da4335d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756361.465102:0:10483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784756361.465187:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+15:10405:x1871452465807360:12345-192.168.202.4@tcp:36:rm.0 Request processed in 1933us (2138us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784756361.465196:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00010000:00010000:0.0:1784756361.477081:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477101:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477110:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477117:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7601678600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756361.477122:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477155:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477173:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b7605173c00) 00010000:00010000:0.0:1784756361.477176:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756361.477181:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756361.477188:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678600/0x1782e2377f025ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756361.869758:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756361.869779:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7637c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489958016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756361.869850:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756361.869918:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958016 00000100:00100000:0.0:1784756361.869925:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958016 00000100:00100000:0.0:1784756361.869986:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756361.869993:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489958016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756361.870288:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784756361.870314:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756361.870337:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489958016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 343us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756361.870345:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1784756361.870382:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7637c4c380 x1871452489958016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756361.870399:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7637c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489958016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756361.870556:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489958144:0@lo:400:kworker.0 00000100:00100000:0.0:1784756361.870602:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756361.870615:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489958400:0@lo:400:kworker.0 00000100:00100000:0.0:1784756361.870629:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489958656:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.870657:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756361.870681:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756361.870687:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489958272:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.870710:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756361.870737:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958400 00000100:00100000:3.0:1784756361.870741:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958400 00000100:00100000:0.0:1784756361.870763:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756361.870781:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958272 00000100:00100000:3.0:1784756361.870785:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958272 00000100:00100000:0.0:1784756361.870786:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756361.870794:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489958528:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.870810:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784756361.870816:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756361.870821:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489958400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756361.870836:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958528 00000100:00100000:0.0:1784756361.870840:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958528 00000100:00100000:0.0:1784756361.870864:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784756361.870870:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489958400:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756361.870872:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489958272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.870885:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784756361.870911:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871452489958272:12345-0@lo:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756361.870912:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784756361.870921:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784756361.870926:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489958528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756361.870970:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958656 00000100:00100000:0.0:1784756361.870974:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958656 00000100:00100000:3.0:1784756361.870979:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871452489958528:12345-0@lo:400:kworker.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756361.870986:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784756361.871007:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756361.871015:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489958656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.871025:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871452489958272:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.871035:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489958400:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.871063:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1871452489958528:0@lo:400:kworker.0 00000100:00080000:3.0:1784756361.871090:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756361.871101:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756361.871166:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958144 00000100:00100000:1.0:1784756361.871172:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958144 00000100:00100000:0.0:1784756361.871218:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489958656:12345-0@lo:400:kworker.0 Request processed in 203us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756361.871222:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784756361.871230:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784756361.871235:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489958144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756361.871294:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3322:x1871452489958144:12345-0@lo:400:kworker.0 Request processed in 62us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756361.871301:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:3.0:1784756361.872026:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763f99fb80 x1871452489958656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756361.872039:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489958656:0@lo:400:kworker.0 00000100:00100000:3.0:1784756361.872051:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3322:1871452489958144:0@lo:400:kworker.0 00010000:00010000:0.0:1784756362.254966:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756362.381646:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489958784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756362.381723:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756362.382037:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958784 00000100:00100000:1.0:1784756362.382047:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958784 00000100:00100000:1.0:1784756362.382106:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756362.382112:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489958784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756362.382132:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756362.382175:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489958784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756362.382182:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784756362.382407:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763f99e680 x1871452489958784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756362.382429:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489958784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756363.277784:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756364.301634:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756365.327372:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756365.390244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756365.390284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756365.390310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756365.390340:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807616 00000100:00100000:3.0:1784756365.390349:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807616 00000100:00100000:0.0:1784756365.390385:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807744 00000100:00100000:0.0:1784756365.390392:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807744 00000100:00100000:3.0:1784756365.390421:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:0.0:1784756365.390431:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:3.0:1784756365.390436:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+14:2353:x1871452465807616:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756365.390445:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:2353:x1871452465807744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756365.390551:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:2353:x1871452465807744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756365.390561:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:2.0:1784756365.390568:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807488 00000100:00100000:2.0:1784756365.390573:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807488 00000100:00100000:2.0:1784756365.390599:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 229 00000100:00100000:2.0:1784756365.390605:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465807488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:0.0:1784756365.390624:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756365.390629:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756365.393162:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+14:2353:x1871452465807616:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2719us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756365.393177:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1784756365.394955:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2353:x1871452465807488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 4339us (4712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756365.394970:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 229 00010000:00010000:0.0:1784756366.349727:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756366.527729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756366.527855:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465807872 00000100:00100000:3.0:1784756366.527864:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465807872 00000100:00100000:3.0:1784756366.527938:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1784756366.527949:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+14:10915:x1871452465807872:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1784756366.527980:0:10483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756366.528003:0:10483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7644d expref: -99 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528088:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528102:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528115:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756366.528291:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784756366.528295:0:10483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784756366.528374:0:10483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528399:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678c00/0x1782e2377f025b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7644d expref: 16 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528418:0:10483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7644d expref: 15 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756366.528426:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7605173000) 00010000:00010000:3.0:1784756366.528429:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784756366.528433:0:10483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7601678a00, rc 0) 00000100:00100000:3.0:1784756366.528519:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+15:10915:x1871452465807872:12345-192.168.202.4@tcp:101:rm.0 Request processed in 572us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756366.528527:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1784756366.536138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756366.536249:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808000 00000100:00100000:0.0:1784756366.536260:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808000 00000100:00100000:0.0:1784756366.536531:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1784756366.536544:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+15:10915:x1871452465808000:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1784756366.536567:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756366.536588:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f025c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76454 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.536708:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.536723:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.536736:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537039:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537047:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537052:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537341:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537349:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537355:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537361:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756366.537365:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537373:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537386:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7605173000) 00010000:00010000:0.0:1784756366.537389:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756366.537394:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537400:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537410:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537417:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537423:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537436:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6bc00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756366.537439:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537445:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537453:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff8b7603c80b00) 00010000:00010000:0.0:1784756366.537456:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756366.537459:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537465:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f025d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537534:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f025c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76454 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537546:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7605173000) 00010000:00010000:0.0:1784756366.537549:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756366.537554:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f025c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76454 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756366.537565:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a400, rc 0) 00000100:00100000:0.0:1784756366.537627:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bab229c-803d-40e3-a820-b17a4715ff86+15:10915:x1871452465808000:12345-192.168.202.4@tcp:101:rm.0 Request processed in 1087us (1498us total) trans 0 rc 301/301 00000100:00100000:0.0:1784756366.537645:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000001:00080000:3.0:1784756366.537651:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1784756366.537664:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1784756366.537693:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1784756366.537709:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1784756366.538089:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489958912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784756366.538142:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756366.538289:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489958912 00000100:00100000:2.0:1784756366.538296:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489958912 00000100:00080000:0.0:1784756366.538339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756366.538349:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756366.538359:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489958912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784756366.538380:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1784756366.538408:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a613888, atime: 0x6a613888, ctime: 0x6a613888, blocks: 0x1 00010000:00010000:2.0:1784756366.538414:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756366.538427:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:2.0:1784756366.538432:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756366.538439:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756366.538495:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756366.538506:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756366.538514:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756366.538540:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784756366.538753:0:6614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756366.538759:0:6614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756366.538766:0:6614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f62e00 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:1.0:1784756366.538769:0:6614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756366.538776:0:6614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756366.538787:0:6614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756366.538791:0:6614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081d80aa5/0x1782e2377f025dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756366.538808:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756366.538809:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756366.538810:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756366.541026:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871452489958912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2663us (2878us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756366.541038:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1784756366.541499:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7640e70700/2, rc 0, transno 4294967300 00000100:00100000:3.0:1784756366.541507:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7640e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489958912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784756366.989784:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489959424:0@lo:400:kworker.0 00000100:00100000:3.0:1784756366.989865:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756366.990067:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756366.990075:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489959296:0@lo:400:kworker.0 00000100:00100000:3.0:1784756366.990115:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756366.990149:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959296 00000100:00100000:3.0:1784756366.990157:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959296 00000100:00100000:3.0:1784756366.990213:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784756366.990222:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489959296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756366.990276:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871452489959296:12345-0@lo:400:kworker.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756366.990284:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784756366.990453:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1871452489959296:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.990675:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489959040:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.990711:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756366.990753:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489959552:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.990776:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756366.990849:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756366.990857:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489959168:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.990879:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756366.990922:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959424 00000100:00100000:0.0:1784756366.990927:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959424 00000100:00100000:0.0:1784756366.990962:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756366.990969:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763af6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991008:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763af6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489959424:12345-0@lo:400:kworker.0 Request processed in 39us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756366.991014:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756366.991203:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959040 00000100:00100000:0.0:1784756366.991207:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959040 00000100:00100000:0.0:1784756366.991229:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784756366.991236:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489959040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991273:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3321:x1871452489959040:12345-0@lo:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756366.991279:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784756366.991299:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959552 00000100:00100000:0.0:1784756366.991303:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959552 00000100:00100000:0.0:1784756366.991321:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959168 00000100:00100000:0.0:1784756366.991323:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959168 00000100:00100000:0.0:1784756366.991335:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784756366.991342:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489959552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871452489959552:12345-0@lo:400:kworker.0 Request processed in 49us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756366.991396:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784756366.991408:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784756366.991414:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489959168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991439:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871452489959168:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756366.991445:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1784756366.991512:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756366.991517:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756366.991542:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871452489959168:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991551:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3321:1871452489959040:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.991563:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1871452489959552:0@lo:400:kworker.0 00010000:00080000:3.0:1784756366.992275:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b763f99ce00 x1871452489959424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756366.992290:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489959424:0@lo:400:kworker.0 00000100:00100000:0.0:1784756366.992647:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756366.992659:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7637c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489959680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756366.992701:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756366.992733:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959680 00000100:00100000:0.0:1784756366.992738:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959680 00000100:00100000:0.0:1784756366.992771:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784756366.992778:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489959680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756366.992807:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756366.992839:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489959680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756366.992845:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1784756366.992869:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b7637c4c380 x1871452489959680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756366.996648:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7637c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489959680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756367.373758:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756367.502901:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489959808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756367.502970:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756367.503157:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959808 00000100:00100000:3.0:1784756367.503164:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959808 00000100:00100000:3.0:1784756367.503238:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784756367.503248:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1871452489959808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756367.503283:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756367.503340:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1871452489959808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756367.503348:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756367.503485:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489959808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756368.397700:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756368.959383:0:11719:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 119l: test nohybrid flag prevents hybrid IO switching ========================================================== 17:39:27 (1784756367) 00000100:00100000:3.0:1784756369.205441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.206178:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808256 00000100:00100000:0.0:1784756369.206189:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808256 00000100:00100000:0.0:1784756369.206323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1784756369.206334:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:11155:x1871452465808256:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.206355:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.206359:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784756369.206388:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7601678a00/0x1782e2377f025c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7644d expref: 6 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.206410:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7605173000) 00010000:00010000:0.0:1784756369.206422:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756369.206437:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7645b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.206909:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.206924:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.206934:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.206992:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.207000:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.207007:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784756369.207817:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784756369.208337:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f025f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208351:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f025f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208361:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f025f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208393:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208399:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208407:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208412:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6aa00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756369.208417:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208433:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208444:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7603c80b00) 00010000:00010000:0.0:1784756369.208447:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756369.208450:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208457:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6aa00/0x1782e2377f025ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756369.208495:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1a65e60 reply state 00000000b9ee5d27 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756369.208503:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784756369.208532:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a200/0x1782e2377f025e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7645b expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208549:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f025f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7645b expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.208556:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:0.0:1784756369.208558:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756369.208560:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6be00, rc 0) 00000100:00100000:0.0:1784756369.208961:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+8:11155:x1871452465808256:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2626us (3528us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784756369.208970:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00080000:2.0:1784756369.209049:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756369.212442:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212461:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212511:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212518:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6b000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1784756369.212523:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212530:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212547:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff8b7603c80d00) 00010000:00010000:3.0:1784756369.212551:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756369.212555:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.212562:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f025f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756369.287952:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.288123:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808384 00000100:00100000:0.0:1784756369.288133:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808384 00000100:00100000:0.0:1784756369.288200:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1784756369.288209:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1871452465808384:12345-192.168.202.4@tcp:8:kworker.0 00010000:00080000:0.0:1784756369.288243:0:6601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8bab229c-803d-40e3-a820-b17a4715ff86@192.168.202.4@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:0.0:1784756369.288278:0:6601:0:(genops.c:1406:class_connect()) connect: client 8bab229c-803d-40e3-a820-b17a4715ff86, cookie 0x1782e2377f02606 00002000:00100000:0.0:1784756369.288291:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bab229c-803d-40e3-a820-b17a4715ff86/ffff8b7637d15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784756369.288318:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784756369.288768:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784756369.288799:0:6601:0:(import.c:65:import_set_state_nolock()) ffff8b7637d14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756369.290174:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:2352:x1871452465808384:12345-192.168.202.4@tcp:8:kworker.0 Request processed in 1957us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756369.290187:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1784756369.299296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.299389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.299807:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808640 00000100:00100000:2.0:1784756369.299817:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808640 00000100:00100000:2.0:1784756369.299993:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808512 00000100:00100000:2.0:1784756369.299997:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808512 00000100:00080000:0.0:1784756369.300038:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756369.300132:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1784756369.300144:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:0:x1871452465808640:12345-192.168.202.4@tcp:4:dd.0 00002000:00010000:3.0:1784756369.300200:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784756369.300209:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.300226:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:3.0:1784756369.300231:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756369.300236:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756369.300253:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1784756369.369971:0:6625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bab229c-803d-40e3-a820-b17a4715ff86 00010000:00010000:0.0:1784756369.422908:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784756369.439178:0:6625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00002000:00010000:2.0:1784756369.439335:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1784756369.439340:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784756368 00002000:00010000:2.0:1784756369.439343:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784756368 00002000:00010000:2.0:1784756369.439346:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1784756369.439360:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439406:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439417:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439425:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7601678c00 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756369.439431:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439441:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439462:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.439809:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd2c9c7c/0x1782e2377f0260d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756369.440066:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:0:x1871452465808640:12345-192.168.202.4@tcp:4:dd.0 Request processed in 139917us (140772us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784756369.440082:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1784756369.440118:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1784756369.440131:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:0:x1871452465808512:12345-192.168.202.4@tcp:4:dd.0 00002000:00010000:0.0:1784756369.440181:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613890, atime: 0x0, ctime: 0x6a613890, blocks: 0x807 00010000:00010000:0.0:1784756369.440188:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.440201:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1784756369.440215:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756369.440223:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.440239:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784756369.529833:0:6625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00002000:00010000:2.0:1784756369.529953:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1784756369.529971:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.529985:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.530016:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.530024:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6a200 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756369.530029:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.530038:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.530059:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.530067:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f02614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756369.530187:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:0:x1871452465808512:12345-192.168.202.4@tcp:4:dd.0 Request processed in 90056us (230790us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756369.530199:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1784756369.551101:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.551206:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465808896 00000100:00100000:2.0:1784756369.551221:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465808896 00000100:00100000:2.0:1784756369.551289:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1784756369.551301:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+7:11155:x1871452465808896:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1784756369.552702:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bab229c-803d-40e3-a820-b17a4715ff86+8:11155:x1871452465808896:12345-192.168.202.4@tcp:35:dd.0 Request processed in 1395us (1604us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784756369.552713:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:3.0:1784756369.613599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.613713:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809024 00000100:00100000:0.0:1784756369.613723:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809024 00000100:00100000:0.0:1784756369.613783:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:0.0:1784756369.613794:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+8:11162:x1871452465809024:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.613823:0:10483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.613847:0:10483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f0261b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76462 expref: -99 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.613949:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f02622 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.613964:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f02622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.613977:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f02622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756369.614059:0:10483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784756369.614063:0:10483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784756369.614090:0:10483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f02622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.614115:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f0261b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76462 expref: 10 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.614147:0:10483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6bc00/0x1782e2377f02622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76462 expref: 9 pid: 10483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.614156:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7603c80900) 00010000:00010000:0.0:1784756369.614159:0:10483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784756369.614163:0:10483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6bc00, rc 0) 00000100:00100000:0.0:1784756369.614240:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+9:11162:x1871452465809024:12345-192.168.202.4@tcp:101:dd.0 Request processed in 448us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756369.614248:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1784756369.621637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.621739:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809280 00000100:00100000:0.0:1784756369.621750:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809280 00000100:00100000:0.0:1784756369.621809:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1784756369.621820:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+9:11162:x1871452465809280:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.621840:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.621870:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76469 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.621969:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02630 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.621984:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.621995:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756369.622006:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:0.0:1784756369.622138:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f02629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76469 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.622154:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6a400/0x1782e2377f02630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76469 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.622162:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:0.0:1784756369.622164:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784756369.622167:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a400, rc 0) 00000100:00100000:0.0:1784756369.622227:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+11:11162:x1871452465809280:12345-192.168.202.4@tcp:101:dd.0 Request processed in 409us (609us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784756369.622234:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1784756369.629294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.629807:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809408 00000100:00100000:0.0:1784756369.629818:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809408 00000100:00100000:0.0:1784756369.629894:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1784756369.629907:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+5:2356:x1871452465809408:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.629928:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.629952:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b011c0a/0x1782e2377f0263e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76470 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784756369.629981:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613890, atime: 0x0, ctime: 0x6a613890, blocks: 0x1007 00010000:00010000:0.0:1784756369.630003:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1784756369.630008:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756369.630018:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b011c0a/0x1782e2377f0263e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76470 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.630035:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b011c0a/0x1782e2377f0263e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76470 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.630067:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6b000, rc 0) 00000100:00100000:0.0:1784756369.630133:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465809408:12345-192.168.202.4@tcp:101:dd.0 Request processed in 228us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756369.630140:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784756369.657225:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.657331:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809536 00000100:00100000:2.0:1784756369.657341:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809536 00000100:00100000:2.0:1784756369.657419:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1784756369.657442:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2353:x1871452465809536:12345-192.168.202.4@tcp:3:dd.0 00010000:00010000:2.0:1784756369.657517:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.657538:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756369.657542:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756369.657549:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.657563:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756369.668319:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.670101:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784756369.670121:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784756369.670374:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809664 00000100:00100000:2.0:1784756369.670385:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809664 00000100:00100000:1.0:1784756369.670915:0:11733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1784756369.670927:0:11733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8bab229c-803d-40e3-a820-b17a4715ff86+8:2356:x1871452465809664:12345-192.168.202.4@tcp:3:dd.0 00010000:00010000:1.0:1784756369.670966:0:11733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.670986:0:11733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756369.670990:0:11733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756369.670998:0:11733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.671015:0:11733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689183:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689210:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689230:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689238:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63000 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:2.0:1784756369.689244:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689275:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689297:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.689305:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006c2c860/0x1782e2377f02645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756369.689394:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bab229c-803d-40e3-a820-b17a4715ff86+8:2353:x1871452465809536:12345-192.168.202.4@tcp:3:dd.0 Request processed in 31948us (32172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1784756369.689403:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00010000:00010000:1.0:1784756369.692965:0:11733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.692986:0:11733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.692994:0:11733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.693016:0:11733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ef800 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:1.0:1784756369.693022:0:11733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.693031:0:11733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.693052:0:11733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.693060:0:11733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120b51fc/0x1782e2377f0264c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756369.693150:0:11733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465809664:12345-192.168.202.4@tcp:3:dd.0 Request processed in 22220us (24836us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756369.693160:0:11733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:3.0:1784756369.756174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.756348:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465809920 00000100:00100000:0.0:1784756369.756360:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465809920 00000100:00100000:0.0:1784756369.756428:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:0.0:1784756369.756439:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+11:11166:x1871452465809920:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1784756369.756541:0:10483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756369.756585:0:10483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f025f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7645b expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.756607:0:10483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:0.0:1784756369.756613:0:10483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756369.756652:0:10483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.756668:0:10483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.756678:0:10483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756369.756941:0:10483:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cee0d5fe reply state 000000006f3d6f0b transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756369.756951:0:10483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756369.757313:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+12:11166:x1871452465809920:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 875us (1149us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784756369.757321:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00010000:00010000:1.0:1784756369.763969:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.763992:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.764001:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.764008:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6ac00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1784756369.764013:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.764043:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.764065:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:1.0:1784756369.764068:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756369.764073:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.764079:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ac00/0x1782e2377f02653 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756369.765196:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.765290:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810048 00000100:00100000:2.0:1784756369.765301:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810048 00000100:00100000:2.0:1784756369.765367:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784756369.765379:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bab229c-803d-40e3-a820-b17a4715ff86+6:2356:x1871452465810048:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1784756369.765727:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1784756369.765732:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1784756368 -> 1784756368 00002000:00010000:2.0:1784756369.765734:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784756369.765736:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1784756368 -> 1784756368 00002000:00010000:2.0:1784756369.765738:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1784756369.765812:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bab229c-803d-40e3-a820-b17a4715ff86+7:2356:x1871452465810048:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 435us (626us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784756369.766213:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784756369.784349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.784506:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810176 00000100:00100000:0.0:1784756369.784518:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810176 00000100:00100000:0.0:1784756369.784603:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1784756369.784616:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:5567:x1871452465810176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784756369.784646:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756369.784907:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b011c0a/0x1782e2377f0263e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76470 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.784940:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756369.785005:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bab229c-803d-40e3-a820-b17a4715ff86+6:5567:x1871452465810176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 392us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756369.785012:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1784756369.834198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.834388:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810432 00000100:00100000:0.0:1784756369.834399:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810432 00000100:00100000:0.0:1784756369.834515:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1784756369.834528:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+11:11173:x1871452465810432:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.834994:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.835024:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f0265a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a76477 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835104:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835118:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835141:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835158:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835166:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835172:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835328:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0266f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835337:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0266f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835344:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0266f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756369.835354:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:0.0:1784756369.835451:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835459:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835493:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835500:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6be00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756369.835511:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835518:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835531:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7603c80900) 00010000:00010000:0.0:1784756369.835534:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756369.835539:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835545:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6be00/0x1782e2377f02661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835560:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835566:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.835571:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836257:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7640e6b400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1784756369.836262:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836271:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836283:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff8b7603c80000) 00010000:00010000:0.0:1784756369.836286:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756369.836299:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836306:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b400/0x1782e2377f02668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836360:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6b000/0x1782e2377f0265a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76477 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836374:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7640e6ba00/0x1782e2377f0266f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a76477 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.836381:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b7603c80200) 00010000:00010000:0.0:1784756369.836384:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756369.836386:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6ba00, rc 0) 00000100:00100000:0.0:1784756369.836990:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bab229c-803d-40e3-a820-b17a4715ff86+13:11173:x1871452465810432:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2460us (2801us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784756369.837002:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1784756369.841418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.841930:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810688 00000100:00100000:2.0:1784756369.841941:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810688 00000100:00100000:2.0:1784756369.842042:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1784756369.842052:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+13:11173:x1871452465810688:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:2.0:1784756369.842406:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bab229c-803d-40e3-a820-b17a4715ff86+14:11173:x1871452465810688:12345-192.168.202.4@tcp:35:dd.0 Request processed in 354us (998us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784756369.842414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1784756369.847273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756369.847352:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810816 00000100:00100000:0.0:1784756369.847363:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810816 00000100:00100000:0.0:1784756369.847430:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1784756369.847439:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+6:2354:x1871452465810816:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1784756369.847497:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756369.847519:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f0267d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a2ce21371a7647e expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784756369.847548:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613890, atime: 0x0, ctime: 0x6a613890, blocks: 0x1007 00010000:00010000:0.0:1784756369.847580:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1784756369.847602:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756369.847613:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f0267d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7647e expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.847632:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b96719ab/0x1782e2377f0267d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x4a2ce21371a7647e expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756369.847646:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7640e6a200, rc 0) 00000100:00100000:0.0:1784756369.847870:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bab229c-803d-40e3-a820-b17a4715ff86+7:2354:x1871452465810816:12345-192.168.202.4@tcp:101:dd.0 Request processed in 422us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756369.847877:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1784756369.904703:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784756369.904939:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465810944 00000100:00100000:1.0:1784756369.904953:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465810944 00000100:00100000:1.0:1784756369.905036:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:1.0:1784756369.905047:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:2355:x1871452465810944:12345-192.168.202.4@tcp:3:dd.0 00010000:00010000:1.0:1784756369.905087:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.905105:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756369.905110:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756369.905117:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.905133:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756369.919773:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784756369.919963:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465811072 00000100:00100000:2.0:1784756369.919975:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465811072 00000100:00100000:2.0:1784756369.920065:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1784756369.920076:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7640e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bab229c-803d-40e3-a820-b17a4715ff86+9:2355:x1871452465811072:12345-192.168.202.4@tcp:3:dd.0 00010000:00010000:2.0:1784756369.920116:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.920136:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756369.920141:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756369.920148:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756369.920162:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.938940:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.938967:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.938978:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.938989:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b76421ee600 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:1.0:1784756369.938994:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.939005:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.939029:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.939038:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de5ad5f/0x1782e2377f02684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756369.939138:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bab229c-803d-40e3-a820-b17a4715ff86+9:2355:x1871452465810944:12345-192.168.202.4@tcp:3:dd.0 Request processed in 34087us (34439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756369.939150:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00010000:00010000:1.0:1784756369.947006:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947046:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947055:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947063:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7624f63e00 already unused, calling callback (ffffffffc15a5230) 00010000:00010000:1.0:1784756369.947069:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947080:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947103:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756369.947111:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb436f24/0x1782e2377f0268b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756369.947209:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7640e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bab229c-803d-40e3-a820-b17a4715ff86+7:2355:x1871452465811072:12345-192.168.202.4@tcp:3:dd.0 Request processed in 27130us (27441us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756369.947220:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00010000:00010000:0.0:1784756370.446545:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756370.512156:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756370.512209:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756370.512240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784756370.512277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784756370.512442:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465811456 00000100:00100000:0.0:1784756370.512452:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465811456 00000100:00100000:0.0:1784756370.512548:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465811584 00000100:00100000:0.0:1784756370.512553:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465811584 00000100:00100000:0.0:1784756370.512603:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1784756370.512613:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:2355:x1871452465811456:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756370.512685:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+7:2355:x1871452465811456:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756370.512706:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1784756370.512724:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:0.0:1784756370.512730:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2355:x1871452465811584:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784756370.512757:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bab229c-803d-40e3-a820-b17a4715ff86+5:2355:x1871452465811584:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756370.512781:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00080000:0.0:1784756370.512799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756370.512939:0:10483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465811328 00000100:00100000:1.0:1784756370.512944:0:10483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465811328 00000100:00100000:1.0:1784756370.512986:0:10483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784756370.512993:0:10483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+14:2355:x1871452465811328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784756370.513035:0:10483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763f99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bab229c-803d-40e3-a820-b17a4715ff86+14:2355:x1871452465811328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756370.513042:0:10483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:2.0:1784756370.513114:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452465811200 00000100:00100000:2.0:1784756370.513118:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452465811200 00000100:00100000:2.0:1784756370.513159:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:2.0:1784756370.513167:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465811200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784756370.513195:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88574ee4-5a0b-461a-86e7-71d74919f81d+10:2355:x1871452465811200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756370.513210:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 231 00000001:02000400:3.0:1784756371.345369:0:11770:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_119l: @@@@@@ FAIL: (5) nohybrid should prevent switch, stats: 1 00010000:00010000:3.0:1784756371.474858:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784756371.662859:0:7515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1784756371.664230:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:3.0:1784756371.664252:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000100:00100000:2.0:1784756372.109954:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489960192:0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110035:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756372.110098:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784756372.110105:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489960064:0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110131:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756372.110148:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489960576:0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110177:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756372.110215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960192 00000100:00100000:2.0:1784756372.110225:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960192 00000100:00100000:2.0:1784756372.110284:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960064 00000100:00100000:2.0:1784756372.110287:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960064 00000100:00100000:2.0:1784756372.110309:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784756372.110317:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489960192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110368:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871452489960192:12345-0@lo:400:kworker.0 Request processed in 51us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756372.110377:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784756372.110396:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784756372.110402:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489960064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110429:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871452489960064:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756372.110435:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784756372.110508:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871452489960064:0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.110518:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1871452489960192:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.110879:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489959936:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.110919:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756372.110947:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489960448:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.110971:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756372.110994:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756372.111000:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489960320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111024:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756372.111058:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960448 00000100:00100000:0.0:1784756372.111062:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960448 00000100:00100000:0.0:1784756372.111094:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784756372.111101:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489960448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111139:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871452489960448:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756372.111145:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784756372.111165:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960576 00000100:00100000:0.0:1784756372.111169:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960576 00000100:00100000:0.0:1784756372.111193:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960320 00000100:00100000:0.0:1784756372.111197:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960320 00000100:00100000:0.0:1784756372.111216:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756372.111222:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b763fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489960576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111252:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b763fec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871452489960576:12345-0@lo:400:kworker.0 Request processed in 30us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756372.111258:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756372.111269:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784756372.111284:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489960320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111313:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871452489960320:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756372.111319:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1784756372.111335:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756372.111339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756372.111342:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756372.111355:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489959936 00000100:00100000:0.0:1784756372.111358:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489959936 00000100:00100000:0.0:1784756372.111384:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784756372.111390:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489959936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111423:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7605ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c73f41-e9a1-4359-8051-7c5e1edb844a+19:3320:x1871452489959936:12345-0@lo:400:kworker.0 Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756372.111429:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784756372.111496:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1871452489960320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111506:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c73f41-e9a1-4359-8051-7c5e1edb844a:3320:1871452489959936:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.111514:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1871452489960448:0@lo:400:kworker.0 00000100:00100000:2.0:1784756372.111777:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1784756372.111783:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7640e70700, transno 4294967300 00000100:00100000:2.0:1784756372.111795:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763fec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1871452489960576:0@lo:400:kworker.0 00000100:00100000:0.0:1784756372.112376:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756372.112389:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489960704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756372.112425:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756372.112529:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960704 00000100:00100000:3.0:1784756372.112536:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960704 00000100:00100000:3.0:1784756372.112580:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784756372.112588:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489960704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756372.112615:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1784756372.112965:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871452489960704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 377us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756372.112973:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784756372.120024:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1871452489960704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756372.493875:0:6614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756372.621831:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489960832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756372.621920:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756372.625709:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452489960832 00000100:00100000:3.0:1784756372.625724:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452489960832 00000100:00100000:3.0:1784756372.625790:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784756372.625802:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7637c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489960832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756372.625855:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756372.625942:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7637c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1871452489960832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756372.625949:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784756372.626010:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b763f99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1871452489960832:0@lo:13:osp-pre-1-0.0 Debug log: 9299 lines, 9299 kept, 0 dropped, 0 bad.